00000001:02000400:0.0F:1787790521.054330:0:2975:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787790537.223218:0:3195:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1787790538.766488:0:3255:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 799 MB/s 00000001:01000000:1.0F:1787790539.016523:0:3255:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 883 MB/s 00000001:01000000:2.0:1787790539.265830:0:3255:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4163 MB/s 00000020:02000000:2.0:1787790539.787544:0:3287:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_50_g504224c 00000400:02000000:1.0:1787790540.294113:0:3302:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.125@tcp [8/256/0/180] 00008000:02000000:1.0:1787790543.309053:0:3452:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1787790585.767193:0:5251:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing load_modules_local 00000020:01000004:3.0F:1787790594.735926:0:5827:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787790594.735936:0:5827:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787790594.736272:0:5827:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000999092ca 00000080:02000400:3.0:1787790594.736285:0:5827:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787790594.740793:0:5827:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787790594.740806:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787790594.740843:0:5827:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000014ebfa35) 00000020:00000080:3.0:1787790594.740861:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787790594.754261:0:5827:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787790594.754761:0:5827:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787790594.772841:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787790594.772881:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787790594.772902:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787790594.772960:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787790594.772991:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787790594.773352:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787790594.773361:0:5827:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787790594.773372:0:5827:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70647b5fa9773f32 00000020:01000004:2.0:1787790594.773379:0:5827:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787790594.773384:0:5827:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787790594.773389:0:5827:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000999092ca from MGS 00000020:01000004:2.0:1787790594.773393:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787790594.773410:0:5827:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000f1550d75) 00000020:00000080:2.0:1787790594.773422:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787790594.773487:0:5827:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000999092ca from MGS, refs=2 00080000:01000000:2.0:1787790594.773492:0:5827:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787790594.773496:0:5827:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70647b5fa9773f40 00000100:00100000:2.0:1787790594.773583:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787790594.773698:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787790594.773704:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787790594.777140:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787790594.777153:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787790594.778187:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787790594.778379:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787790594.778385:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787790594.779080:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787790594.779097:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787790594.781936:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787790594.781955:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787790594.782786:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790594.782791:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790594.782792:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790594.783157:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790594.783159:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790594.783161:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790594.783634:0:5827:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787790594.785766:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787790595.033054:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2987 MB/s 00000001:01000000:0.0:1787790595.286003:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3731 MB/s 00000001:01000000:0.0:1787790595.536071:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 599 MB/s 00000001:01000000:2.0:1787790595.787100:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 741 MB/s 00080000:10000000:2.0:1787790595.808956:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1787790595.829368:0:5827:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787790595.829395:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787790595.829399:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787790595.830458:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787790595.830521:0:5827:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787790595.830570:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787790595.831016:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787790595.831048:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787790595.831376:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787790595.831543:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787790595.831549:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787790595.841773:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787790595.841793:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00010000:00010000:2.0:1787790595.843977:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790595.852303:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787790595.852849:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787790595.862278:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787790595.862304:0:5827:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.125@tcp' 00000020:01000004:0.0:1787790595.862306:0:5827:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787790595.862358:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.125@tcp (typ=mgc) 00000020:00000080:0.0:1787790595.862388:0:5827:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.125@tcp (00000000fab3ca6d) 00000020:00000080:0.0:1787790595.862405:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787790595.862537:0:5827:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000098355d42@MGC192.168.201.125@tcp: add connection 192.168.201.125@tcp at head 00010000:00010000:0.0:1787790595.862855:0:5827:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.125@tcp-0 is initialized 00000040:01000000:0.0:1787790595.862862:0:5827:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787790595.870242:0:5842:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787790595.880821:0:5843:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787790595.880982:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.125@tcp (uuid e4f5edb7-fc08-421f-83d8-e03ffbb6fa21) 00000020:00000080:1.0:1787790595.881008:0:5827:0:(genops.c:1385:class_connect()) connect: client e4f5edb7-fc08-421f-83d8-e03ffbb6fa21, cookie 0x70647b5fa9773f4e 00000100:00080000:1.0:1787790595.881022:0:5827:0:(import.c:510:import_select_connection()) MGC192.168.201.125@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787790595.881028:0:5827:0:(import.c:624:import_select_connection()) MGC192.168.201.125@tcp: import 0000000098355d42 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:1.0:1787790595.881060:0:5827:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002989794b x1874634253271168/t0(0) o250->MGC192.168.201.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787790595.881104:0:5827:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e4f5edb7-fc08-421f-83d8-e03ffbb6fa21->MGS 00000020:01000004:1.0:1787790595.881212:0:5827:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787790595.881239:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787790595.881265:0:5827:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000f27edb40) 00000020:00000080:1.0:1787790595.881278:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787790595.884488:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002989794b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3317:1874634253271168:0@lo:250: 00000100:00100000:3.0:1787790595.884587:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790595.891460:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253271168 00000100:00100000:0.0:1787790595.891476:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253271168 00000100:00100000:0.0:1787790595.891585:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790595.891592:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008847edc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3317:x1874634253271168:12345-0@lo:250: 00010000:00080000:0.0:1787790595.892212:0:5840:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e4f5edb7-fc08-421f-83d8-e03ffbb6fa21@0@lo t0 exp 0000000000000000 cur 130 last 0 00000020:00000080:0.0:1787790595.892242:0:5840:0:(genops.c:1385:class_connect()) connect: client e4f5edb7-fc08-421f-83d8-e03ffbb6fa21, cookie 0x70647b5fa9773f5c 00000100:00080000:0.0:1787790595.892822:0:5840:0:(import.c:65:import_set_state_nolock()) 00000000286c6a0a : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787790595.892914:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008847edc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+5:3317:x1874634253271168:12345-0@lo:250: Request processed in 1320us (8326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790595.892924:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790595.892980:0:3317:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.125@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787790595.892990:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.125@tcp: connect to target with instance 0 00000100:00080000:0.0:1787790595.892998:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.125@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787790595.893004:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787790595.893007:0:3317:0:(import.c:65:import_set_state_nolock()) 0000000098355d42 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787790595.893010:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787790595.893020:0:3317:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787790595.893024:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002989794b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3317:1874634253271168:0@lo:250: 00000100:00100000:1.0:1787790595.901949:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787790595.902141:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787790595.902147:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787790595.903536:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787790595.903547:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787790595.904478:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787790595.904485:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787790595.905266:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787790595.905506:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787790595.905512:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787790595.913124:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787790595.913144:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787790596.005047:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787790596.008141:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787790596.008151:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787790596.016567:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787790596.016591:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787790596.017506:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787790596.017696:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787790596.017701:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787790596.018315:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787790596.018322:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787790596.019324:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787790596.019473:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787790596.019478:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787790596.020885:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787790596.020896:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787790596.021489:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787790596.021829:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787790596.021835:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787790596.023096:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787790596.023105:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787790596.098826:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787790596.099031:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787790596.099037:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787790596.115009:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787790596.119804:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787790596.122584:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787790596.122607:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787790596.133428:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787790596.133486:0:5827:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787790596.133493:0:5827:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.125@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787790596.133674:0:5827:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787790596.133718:0:5827:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.125@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787790596.136819:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787790596.136822:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787790596.136823:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790596.136824:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790596.136825:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790596.136827:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790596.136828:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787790596.136829:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787790596.136831:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787790596.136832:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787790596.136833:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790596.136834:0:5827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787790596.136839:0:5827:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787790596.136842:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787790596.136843:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787790596.136844:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790596.136845:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790596.136846:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790596.136847:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790596.136847:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787790596.136849:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787790596.136849:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787790596.136850:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787790596.136851:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790596.136852:0:5827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787790596.136911:0:5827:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787790596.136936:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009819cdbe pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253271296:0@lo:253: 00000100:00100000:1.0:1787790596.137049:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790596.137115:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 000000002d8c770e going to sleep for 11 seconds 00000100:00100000:3.0:1787790596.137278:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253271296 00000100:00100000:3.0:1787790596.137286:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253271296 00000100:00100000:3.0:1787790596.137337:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790596.137345:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc51b04e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+5:5827:x1874634253271296:12345-0@lo:253: 20000000:01000000:3.0:1787790596.137398:0:5841:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787790596.137401:0:5841:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1787790596.148550:0:5862:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787790596.148950:0:5841:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787790596.149353:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787790596.150339:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1787790596.162286:0:5841:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787790596.162294:0:5841:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1787790596.162301:0:5841:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1787790596.162305:0:5841:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1787790596.162323:0:5841:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1787790596.162548:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787790596.163383:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787790596.163400:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787790596.163452:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787790596.163521:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787790596.164110:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787790596.164253:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787790596.164263:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787790596.164336:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787790596.164345:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787790596.164378:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787790596.164394:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787790596.164430:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787790596.164498:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787790596.164535:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787790596.164541:0:5841:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787790596.164555:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787790596.164851:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787790596.164862:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787790596.164898:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787790596.164933:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787790596.164982:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787790596.164994:0:5841:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787790596.165078:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787790596.165087:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787790596.165132:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787790596.165170:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787790596.165197:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787790596.165205:0:5841:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787790596.165269:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787790596.165277:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787790596.165317:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787790596.165345:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787790596.165496:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787790596.165537:0:5841:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787790596.165545:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1787790596.170920:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1787790596.171308:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1787790596.171333:0:5841:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.125@tcp for mdt 20000000:01000000:3.0:1787790596.171335:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.125@tcp (null) (null) (null) 00000040:00080000:3.0:1787790596.171364:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1787790596.171371:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787790596.171394:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1787790596.171400:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.125@tcp (null) (null) 00000040:00080000:3.0:1787790596.171449:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1787790596.171458:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787790596.171485:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1787790596.171514:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1787790596.171567:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787790596.171570:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787790596.171573:0:5841:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787790596.171583:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787790596.171586:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787790596.171993:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787790596.171996:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787790596.178880:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1787790596.179299:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1787790596.179344:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1787790596.179426:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1787790596.179439:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787790596.179442:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787790596.187556:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1787790596.188135:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1787790596.188189:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1787790596.188225:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1787790596.188237:0:5841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787790596.188239:0:5841:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1787790596.188244:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787790596.188246:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787790596.188251:0:5841:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787790596.188258:0:5841:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787790596.189201:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1787790596.189320:0:5841:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787790596.204258:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1787790596.204313:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1787790596.204409:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1787790596.204434:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787790596.204454:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000040820f7a/0x70647b5fa9773f63 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.204470:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000040820f7a/0x70647b5fa9773f63 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.204480:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000040820f7a/0x70647b5fa9773f63 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.204486:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000040820f7a/0x70647b5fa9773f63 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.204492:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000040820f7a/0x70647b5fa9773f63 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.204509:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000040820f7a/0x70647b5fa9773f63 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.204515:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000040820f7a already unused, calling callback (00000000eb16bc23) 00010000:00010000:2.0:1787790596.204519:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000040820f7a/0x70647b5fa9773f63 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.204526:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000040820f7a/0x70647b5fa9773f63 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.204538:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000040820f7a/0x70647b5fa9773f63 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.204545:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000040820f7a/0x70647b5fa9773f63 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.204550:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000040820f7a/0x70647b5fa9773f63 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787790596.204566:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787790596.482543:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc51b04e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+5:5827:x1874634253271296:12345-0@lo:253: Request processed in 345191us (345487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790596.482564:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787790596.482785:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009819cdbe pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253271296:0@lo:253: 10000000:01000000:1.0:1787790596.482802:0:5827:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787790596.482805:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787790596.482807:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787790596.482808:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790596.482809:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787790596.482811:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790596.482820:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790596.482821:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787790596.482823:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787790596.482824:0:5827:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787790596.482826:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790596.482828:0:5827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787790596.482847:0:5827:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000999092ca from lustre-MDT0000 10000000:01000000:1.0:1787790596.482872:0:5827:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787790596.482875:0:5827:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787790596.482879:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff931a44ec4d28 10000000:01000000:1.0:1787790596.482884:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787790596.482893:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff931a44ec4d28 from 1 10000000:01000000:1.0:1787790596.482896:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787790596.482934:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 000000007f35da0c/0x70647b5fa9773f6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790596.482945:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 000000007f35da0c/0x70647b5fa9773f6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790596.482954:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 000000007f35da0c/0x70647b5fa9773f6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790596.482973:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009819cdbe pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253271424:0@lo:101: 00000100:00100000:1.0:1787790596.483025:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790596.483178:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 000000004f7892a4 going to sleep for 11 seconds 00000100:00100000:2.0:1787790596.483482:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253271424 00000100:00100000:2.0:1787790596.483488:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253271424 00000100:00100000:2.0:1787790596.483578:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787790596.483587:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fb3adaf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+5:5827:x1874634253271424:12345-0@lo:101: 00010000:00010000:2.0:1787790596.483599:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790596.483668:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000040820f7a/0x70647b5fa9773f71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9773f6a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.483699:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000040820f7a/0x70647b5fa9773f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9773f6a expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.483710:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000040820f7a/0x70647b5fa9773f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9773f6a expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.483718:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000040820f7a, rc 0) 00000100:00100000:2.0:1787790596.483849:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fb3adaf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+6:5827:x1874634253271424:12345-0@lo:101: Request processed in 263us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790596.483856:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787790596.483926:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009819cdbe pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253271424:0@lo:101: 00010000:00010000:1.0:1787790596.483940:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 000000007f35da0c/0x70647b5fa9773f6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9773f71 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790596.483949:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 000000007f35da0c/0x70647b5fa9773f6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9773f71 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790596.484008:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009819cdbe pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253271552:0@lo:501: 00000100:00100000:1.0:1787790596.484161:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790596.484194:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 000000004f7892a4 going to sleep for 11 seconds 00000100:00100000:3.0:1787790596.484253:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253271552 00000100:00100000:3.0:1787790596.484257:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253271552 00000100:00100000:3.0:1787790596.484287:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787790596.484292:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071077c47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+6:5827:x1874634253271552:12345-0@lo:501: 00000100:00100000:3.0:1787790596.484521:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071077c47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+6:5827:x1874634253271552:12345-0@lo:501: Request processed in 229us (361us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787790596.484528:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787790596.484593:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009819cdbe pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253271552:0@lo:501: 10000000:01000000:1.0:1787790596.484628:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787790596.484640:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 000000007f35da0c/0x70647b5fa9773f6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9773f71 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790596.484648:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 000000007f35da0c/0x70647b5fa9773f6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9773f71 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790596.484656:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff931a4977d000 10000000:01000000:1.0:1787790596.484660:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787790596.484664:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff931a4977d000 10000000:01000000:1.0:1787790596.484666:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787790596.484668:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff931a4977d000 from 1 10000000:01000000:1.0:1787790596.484670:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787790596.484686:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 000000002198c715/0x70647b5fa9773f78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790596.484692:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 000000002198c715/0x70647b5fa9773f78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790596.484698:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 000000002198c715/0x70647b5fa9773f78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790596.484709:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009819cdbe pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253271680:0@lo:101: 00000100:00100000:1.0:1787790596.484768:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790596.484780:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 000000004f7892a4 going to sleep for 11 seconds 00000100:00100000:0.0:1787790596.484994:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253271680 00000100:00100000:0.0:1787790596.484998:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253271680 00000100:00100000:0.0:1787790596.485033:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787790596.485039:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a309e804 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+6:5827:x1874634253271680:12345-0@lo:101: 00010000:00010000:0.0:1787790596.485047:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790596.485073:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000079aa5aa2/0x70647b5fa9773f7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9773f78 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.485088:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000079aa5aa2/0x70647b5fa9773f7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9773f78 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.485096:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000079aa5aa2/0x70647b5fa9773f7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9773f78 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.485102:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000079aa5aa2, rc 0) 00000100:00100000:0.0:1787790596.485144:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a309e804 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+7:5827:x1874634253271680:12345-0@lo:101: Request processed in 105us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790596.485151:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787790596.488463:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009819cdbe pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253271680:0@lo:101: 00010000:00010000:1.0:1787790596.488489:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 000000002198c715/0x70647b5fa9773f78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9773f7f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790596.488500:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 000000002198c715/0x70647b5fa9773f78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9773f7f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790596.488517:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787790596.488520:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 000000002198c715/0x70647b5fa9773f78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9773f7f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790596.488526:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 000000002198c715/0x70647b5fa9773f78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9773f7f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790596.488533:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787790596.488541:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787790596.488546:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff931a4977d000 10000000:01000000:1.0:1787790596.488548:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787790596.488551:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787790596.488553:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787790596.488579:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 00000000655fff30/0x70647b5fa9773f86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790596.488585:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 00000000655fff30/0x70647b5fa9773f86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790596.488590:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 00000000655fff30/0x70647b5fa9773f86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790596.488622:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009819cdbe pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253271808:0@lo:101: 00000100:00100000:1.0:1787790596.488668:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790596.488701:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 000000004f7892a4 going to sleep for 11 seconds 00000100:00100000:3.0:1787790596.488915:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253271808 00000100:00100000:3.0:1787790596.488921:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253271808 00000100:00100000:3.0:1787790596.488957:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787790596.488964:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3c63fed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+7:5827:x1874634253271808:12345-0@lo:101: 00010000:00010000:3.0:1787790596.488974:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790596.488987:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000227e48f4/0x70647b5fa9773f8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9773f86 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790596.489003:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000227e48f4/0x70647b5fa9773f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9773f86 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790596.489021:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000227e48f4/0x70647b5fa9773f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9773f86 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790596.489029:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000227e48f4, rc 0) 00000100:00100000:3.0:1787790596.489075:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3c63fed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+8:5827:x1874634253271808:12345-0@lo:101: Request processed in 111us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790596.489082:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787790596.489385:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009819cdbe pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253271808:0@lo:101: 00010000:00010000:1.0:1787790596.489395:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 00000000655fff30/0x70647b5fa9773f86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9773f8d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790596.489412:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 00000000655fff30/0x70647b5fa9773f86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9773f8d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790596.489454:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009819cdbe pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253271936:0@lo:501: 00000100:00100000:1.0:1787790596.489474:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790596.489495:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 000000004f7892a4 going to sleep for 11 seconds 00000100:00100000:0.0:1787790596.489536:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253271936 00000100:00100000:0.0:1787790596.489539:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253271936 00000100:00100000:0.0:1787790596.489563:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787790596.489567:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045bb1fb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+8:5827:x1874634253271936:12345-0@lo:501: 00000100:00100000:0.0:1787790596.489819:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045bb1fb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+9:5827:x1874634253271936:12345-0@lo:501: Request processed in 251us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790596.489827:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787790596.490033:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009819cdbe pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253271936:0@lo:501: 00000100:00100000:1.0:1787790596.490072:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009819cdbe pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253272064:0@lo:503: 00000100:00100000:1.0:1787790596.490111:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790596.490138:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 000000004f7892a4 going to sleep for 11 seconds 00000100:00100000:0.0:1787790596.490251:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253272064 00000100:00100000:0.0:1787790596.490255:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253272064 00000100:00100000:0.0:1787790596.490285:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787790596.490290:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004234b436 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+9:5827:x1874634253272064:12345-0@lo:503: 00000100:00100000:0.0:1787790596.490438:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004234b436 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+9:5827:x1874634253272064:12345-0@lo:503: Request processed in 148us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790596.490445:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787790596.491643:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009819cdbe pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253272064:0@lo:503: 00000100:00100000:1.0:1787790596.492251:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009819cdbe pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5869:1874634253272192:0@lo:502: 00000100:00100000:1.0:1787790596.492307:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790596.492380:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c1d8953a going to sleep for 11 seconds 00000100:00100000:0.0:1787790596.492476:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253272192 00000100:00100000:0.0:1787790596.492481:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253272192 00000100:00100000:0.0:1787790596.492517:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787790596.492524:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006545043 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+9:5869:x1874634253272192:12345-0@lo:502: 00000100:00100000:0.0:1787790596.492972:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006545043 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+9:5869:x1874634253272192:12345-0@lo:502: Request processed in 448us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790596.492979:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787790596.493103:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009819cdbe pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5869:1874634253272192:0@lo:502: 00000020:01000000:1.0:1787790596.493126:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787790596.493136:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790596.493143:0:5869:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787790596.493147:0:5869:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787790596.493150:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787790596.493163:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000022d5af86) 00000020:00000080:1.0:1787790596.493180:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787790596.493184:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787790596.493252:0:5869:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787790596.493258:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70647b5fa9773f9b 00000020:00000080:1.0:1787790596.493550:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787790596.493554:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787790596.493558:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790596.493559:0:5869:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787790596.493562:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787790596.493564:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790596.493566:0:5869:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787790596.493569:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787790596.493575:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000000c1ad1c0) 00000020:00000080:1.0:1787790596.493584:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787790596.493587:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787790596.493589:0:5869:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787790596.493591:0:5869:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787790596.493596:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787790596.493707:0:5869:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000999092ca from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787790596.493720:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000004f66d534) 00000020:00000080:1.0:1787790596.493798:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787790596.493864:0:5869:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787790596.493870:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x70647b5fa9773fb0 00000020:00000080:1.0:1787790596.493981:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787790596.493988:0:5869:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787790596.493992:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x70647b5fa9773fb7 00080000:01000000:1.0:1787790596.493996:0:5869:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787790596.493999:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70647b5fa9773fbe 00080000:10000000:1.0:1787790596.494512:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1787790596.495380:0:5869:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787790596.500123:0:5869:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787790596.609413:0:5869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787790596.609829:0:5869:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787790596.611877:0:5869:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787790596.612154:0:5869:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787790596.641925:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000005c404cb7) 00000020:00000080:2.0:1787790596.641945:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787790596.642002:0:5869:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787790596.642007:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70647b5fa9773fcc 00000020:00000080:2.0:1787790596.642467:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787790596.643772:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787790596.676509:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787790596.708612:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787790596.737952:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787790596.770011:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787790596.798566:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1787790596.820844:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x70647b5fa9773fd3 00000020:00000080:2.0:1787790596.821963:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787790596.821974:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790596.821981:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790596.821983:0:5869:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787790596.821993:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790596.821997:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790596.821998:0:5869:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787790596.822001:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787790596.822003:0:5869:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787790596.822006:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790596.822009:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790596.822010:0:5869:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787790596.822012:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790596.822016:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790596.822018:0:5869:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787790596.822022:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787790596.822087:0:5869:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1787790596.822143:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f64304fc pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5869:1874634253272320:0@lo:502: 00000100:00100000:2.0:1787790596.822218:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790596.822339:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e2ce87b going to sleep for 11 seconds 00000100:00100000:3.0:1787790596.822402:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253272320 00000100:00100000:3.0:1787790596.822409:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253272320 00000100:00100000:3.0:1787790596.822449:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787790596.822456:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f283413b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+9:5869:x1874634253272320:12345-0@lo:502: 00000100:00100000:3.0:1787790596.823153:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f283413b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+9:5869:x1874634253272320:12345-0@lo:502: Request processed in 695us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790596.823163:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787790596.823277:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f64304fc pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5869:1874634253272320:0@lo:502: 00000020:01000000:2.0:1787790596.823308:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790596.823314:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790596.823315:0:5869:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1787790596.823319:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787790596.823562:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787790596.823583:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787790596.823605:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 00000000655fff30/0x70647b5fa9773f86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9773f8d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790596.823688:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 00000000655fff30/0x70647b5fa9773f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9773f8d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790596.823696:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff931a4977d000 from 1 10000000:01000000:3.0:1787790596.823698:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787790596.823748:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 00000000cbe85876/0x70647b5fa9773fda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790596.823757:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 00000000cbe85876/0x70647b5fa9773fda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790596.823766:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 00000000cbe85876/0x70647b5fa9773fda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790596.823781:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f8c58f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253272448:0@lo:101: 00000100:00100000:3.0:1787790596.823820:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790596.823951:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 000000005ccabebe going to sleep for 11 seconds 00000100:00100000:1.0:1787790596.824467:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253272448 00000100:00100000:1.0:1787790596.824481:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253272448 00000100:00100000:1.0:1787790596.824559:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787790596.824566:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0991083 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+9:5827:x1874634253272448:12345-0@lo:101: 00010000:00010000:1.0:1787790596.824578:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790596.824591:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000052d52779/0x70647b5fa9773fe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9773fda expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790596.824620:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000052d52779/0x70647b5fa9773fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9773fda expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790596.824630:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000052d52779/0x70647b5fa9773fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9773fda expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790596.824637:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000052d52779, rc 0) 00000100:00100000:1.0:1787790596.824756:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0991083 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+10:5827:x1874634253272448:12345-0@lo:101: Request processed in 190us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790596.824762:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787790596.825068:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f8c58f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253272448:0@lo:101: 00010000:00010000:0.0:1787790596.825082:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 00000000cbe85876/0x70647b5fa9773fda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9773fe1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.825091:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 00000000cbe85876/0x70647b5fa9773fda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9773fe1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790596.826146:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be6f43f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253272576:0@lo:256: 00000100:00100000:0.0:1787790596.826209:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790596.827479:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 000000006d8a4866 going to sleep for 11 seconds 00000100:00100000:1.0:1787790596.827774:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253272576 00000100:00100000:1.0:1787790596.827786:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253272576 00000100:00100000:1.0:1787790596.827851:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787790596.827862:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4dc9a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+10:5827:x1874634253272576:12345-0@lo:256: 20000000:01000000:1.0:1787790596.827893:0:5841:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787790596.827899:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787790596.828151:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4dc9a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+10:5827:x1874634253272576:12345-0@lo:256: Request processed in 293us (1942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790596.828164:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787790596.828263:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be6f43f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253272576:0@lo:256: 10000000:01000000:0.0:1787790596.828990:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787790596.829084:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 00000000cbe85876/0x70647b5fa9773fda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9773fe1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.829097:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 00000000cbe85876/0x70647b5fa9773fda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9773fe1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790596.829105:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff931a4977d000 from 1 10000000:01000000:0.0:1787790596.829108:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787790596.829142:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 000000007e2a94f4/0x70647b5fa9773fe8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.829149:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 000000007e2a94f4/0x70647b5fa9773fe8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.829169:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 000000007e2a94f4/0x70647b5fa9773fe8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790596.829202:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be6f43f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253272704:0@lo:101: 00000100:00100000:0.0:1787790596.829245:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790596.829273:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 000000006d8a4866 going to sleep for 11 seconds 00000100:00100000:2.0:1787790596.829642:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253272704 00000100:00100000:2.0:1787790596.829648:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253272704 00000100:00100000:2.0:1787790596.829681:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787790596.829688:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c62c11e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+10:5827:x1874634253272704:12345-0@lo:101: 00010000:00010000:2.0:1787790596.829698:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790596.829711:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000970ac13c/0x70647b5fa9773fef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9773fe8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.829750:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000970ac13c/0x70647b5fa9773fef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9773fe8 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.829767:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000970ac13c/0x70647b5fa9773fef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9773fe8 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.829776:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000970ac13c, rc 0) 00000100:00100000:2.0:1787790596.829808:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c62c11e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:5827:x1874634253272704:12345-0@lo:101: Request processed in 120us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790596.829814:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787790596.830009:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be6f43f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253272704:0@lo:101: 00010000:00010000:0.0:1787790596.830022:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 000000007e2a94f4/0x70647b5fa9773fe8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9773fef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.830030:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 000000007e2a94f4/0x70647b5fa9773fe8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9773fef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790596.830093:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be6f43f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253272832:0@lo:501: 00000100:00100000:0.0:1787790596.830214:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790596.830235:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 000000006d8a4866 going to sleep for 11 seconds 00000100:00100000:2.0:1787790596.830269:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253272832 00000100:00100000:2.0:1787790596.830272:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253272832 00000100:00100000:2.0:1787790596.830293:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787790596.830297:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086a1f931 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:5827:x1874634253272832:12345-0@lo:501: 00000100:00100000:2.0:1787790596.831398:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086a1f931 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:5827:x1874634253272832:12345-0@lo:501: Request processed in 1097us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790596.831405:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787790596.832427:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be6f43f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253272832:0@lo:501: 00000100:00100000:0.0:1787790596.832469:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be6f43f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253272960:0@lo:503: 00000100:00100000:0.0:1787790596.832520:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790596.832580:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 000000006d8a4866 going to sleep for 11 seconds 00000100:00100000:1.0:1787790596.832659:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253272960 00000100:00100000:1.0:1787790596.832664:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253272960 00000100:00100000:2.0:1787790596.833165:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787790596.833171:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000949f8f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:5827:x1874634253272960:12345-0@lo:503: 00000040:00080000:2.0:1787790596.833208:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787790596.833282:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000949f8f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:5827:x1874634253272960:12345-0@lo:503: Request processed in 111us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790596.833287:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787790596.833348:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be6f43f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253272960:0@lo:503: 00000040:00080000:3.0:1787790596.834403:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787790596.834552:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787790596.834571:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787790596.834605:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 000000007e2a94f4/0x70647b5fa9773fe8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9773fef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.834618:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 000000007e2a94f4/0x70647b5fa9773fe8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9773fef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790596.834658:0:5827:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787790596.834660:0:5827:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff931a4977d000 10000000:01000000:0.0:1787790596.834662:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff931a4977d000 10000000:01000000:0.0:1787790596.834665:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787790596.834668:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff931a4977d000 from 1 10000000:01000000:0.0:1787790596.834670:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787790596.834694:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 00000000fb6364d7/0x70647b5fa9773ff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.834699:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 00000000fb6364d7/0x70647b5fa9773ff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.834705:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 00000000fb6364d7/0x70647b5fa9773ff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790596.834718:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be6f43f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253273088:0@lo:101: 00000100:00100000:0.0:1787790596.834790:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790596.834820:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3ee7025 going to sleep for 11 seconds 00000100:00100000:2.0:1787790596.834927:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253273088 00000100:00100000:2.0:1787790596.834933:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253273088 00000100:00100000:2.0:1787790596.834960:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787790596.834964:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074b7e71f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:5827:x1874634253273088:12345-0@lo:101: 00010000:00010000:2.0:1787790596.834972:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790596.834981:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f90b2054/0x70647b5fa9773ffd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9773ff6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.835007:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f90b2054/0x70647b5fa9773ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9773ff6 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.835018:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f90b2054/0x70647b5fa9773ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9773ff6 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.835026:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f90b2054, rc 0) 00000100:00100000:2.0:1787790596.835065:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074b7e71f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:5827:x1874634253273088:12345-0@lo:101: Request processed in 100us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790596.835072:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787790596.835274:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be6f43f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253273088:0@lo:101: 00010000:00010000:0.0:1787790596.835285:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 00000000fb6364d7/0x70647b5fa9773ff6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9773ffd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.835290:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 00000000fb6364d7/0x70647b5fa9773ff6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9773ffd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790596.835326:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be6f43f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253273216:0@lo:501: 00000100:00100000:0.0:1787790596.835343:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790596.835367:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3ee7025 going to sleep for 11 seconds 00000100:00100000:2.0:1787790596.835402:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253273216 00000100:00100000:2.0:1787790596.835405:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253273216 00000100:00100000:2.0:1787790596.835426:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787790596.835432:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068db52b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:5827:x1874634253273216:12345-0@lo:501: 00000100:00100000:2.0:1787790596.835629:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068db52b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:5827:x1874634253273216:12345-0@lo:501: Request processed in 198us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790596.835634:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787790596.835747:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be6f43f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253273216:0@lo:501: 00000100:00100000:0.0:1787790596.835776:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be6f43f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253273344:0@lo:503: 00000100:00100000:0.0:1787790596.835811:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790596.835829:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3ee7025 going to sleep for 11 seconds 00000100:00100000:1.0:1787790596.835868:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253273344 00000100:00100000:1.0:1787790596.835878:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253273344 00000100:00100000:1.0:1787790596.835910:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787790596.835915:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd43cc58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:5827:x1874634253273344:12345-0@lo:503: 00000100:00100000:1.0:1787790596.836070:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd43cc58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:5827:x1874634253273344:12345-0@lo:503: Request processed in 155us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790596.836077:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787790596.836096:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be6f43f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253273344:0@lo:503: 00000100:00100000:3.0:1787790596.836381:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e7ba20 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5874:1874634253273472:0@lo:502: 00000100:00100000:3.0:1787790596.836407:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790596.836430:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set 000000007c334902 going to sleep for 11 seconds 00000100:00100000:2.0:1787790596.836459:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253273472 00000100:00100000:2.0:1787790596.836461:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253273472 00000100:00100000:2.0:1787790596.836481:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787790596.836487:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bdd0141 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:5874:x1874634253273472:12345-0@lo:502: 00000100:00100000:2.0:1787790596.836599:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bdd0141 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:5874:x1874634253273472:12345-0@lo:502: Request processed in 113us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790596.836603:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787790596.836699:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e7ba20 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5874:1874634253273472:0@lo:502: 00000020:01000004:3.0:1787790596.836771:0:5874:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787790596.836785:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000060ac4fe0) 00000020:00000080:3.0:1787790596.836808:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787790596.836867:0:5874:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000999092ca from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787790596.836870:0:5874:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000999092ca from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787790596.836872:0:5874:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000999092ca 4 00010000:00080000:3.0:1787790596.836891:0:5874:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000081ac778f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.125@tcp at head 00010000:00010000:3.0:1787790596.838260:0:5874:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787790596.838444:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787790596.838469:0:5874:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787790596.838476:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x70647b5fa977400b 00000100:00080000:3.0:1787790596.838483:0:5874:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787790596.838486:0:5874:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000081ac778f using connection 192.168.201.125@tcp/0@lo 00000100:00100000:3.0:1787790596.838510:0:5874:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000051e7ba20 x1874634253273600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787790596.838530:0:5874:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787790596.838578:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e7ba20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874634253273600:0@lo:38: 00000100:00100000:1.0:1787790596.838640:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790596.839289:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253273600 00000100:00100000:3.0:1787790596.839295:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253273600 00000100:00100000:3.0:1787790596.839323:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787790596.839329:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009819cdbe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1874634253273600:12345-0@lo:38: 00000100:00100000:3.0:1787790596.839384:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009819cdbe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1874634253273600:12345-0@lo:38: Request processed in 53us (744us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787790596.839390:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787790596.839414:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787790596.839422:0:3317:0:(import.c:65:import_set_state_nolock()) 0000000081ac778f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787790596.839427:0:3317:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787790596.839430:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e7ba20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874634253273600:0@lo:38: 00000100:00100000:3.0:1787790596.839575:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e2070b3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5874:1874634253273728:0@lo:502: 00000100:00100000:3.0:1787790596.839606:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790596.839636:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set 000000007095290a going to sleep for 11 seconds 00000100:00100000:1.0:1787790596.839649:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253273728 00000100:00100000:1.0:1787790596.839653:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253273728 00000100:00100000:1.0:1787790596.839691:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787790596.839698:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007289c7eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:5874:x1874634253273728:12345-0@lo:502: 00000100:00100000:1.0:1787790596.839928:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007289c7eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:5874:x1874634253273728:12345-0@lo:502: Request processed in 230us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790596.839935:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787790596.839974:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e2070b3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5874:1874634253273728:0@lo:502: 00000040:00080000:1.0:1787790596.839994:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787790596.841877:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787790596.841903:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787790596.841922:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 00000000fb6364d7/0x70647b5fa9773ff6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9773ffd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.841935:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 00000000fb6364d7/0x70647b5fa9773ff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9773ffd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787790596.841980:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787790596.841982:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787790596.841983:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787790596.841984:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787790596.841985:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787790596.841986:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787790596.841986:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787790596.841987:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787790596.841988:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787790596.841989:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787790596.841990:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787790596.841991:0:5827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787790596.841994:0:5827:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787790596.841995:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787790596.841996:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787790596.841997:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787790596.841997:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787790596.841998:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787790596.841998:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787790596.842001:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787790596.842002:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787790596.842003:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787790596.842003:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787790596.842004:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787790596.842004:0:5827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787790596.842026:0:5827:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787790596.842040:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be6f43f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253273856:0@lo:253: 00000100:00100000:0.0:1787790596.842110:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790596.842135:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 000000006d8a4866 going to sleep for 11 seconds 00000100:00100000:1.0:1787790596.842146:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253273856 00000100:00100000:1.0:1787790596.842153:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253273856 00000100:00100000:1.0:1787790596.842197:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787790596.842205:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066572246 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:5827:x1874634253273856:12345-0@lo:253: 20000000:01000000:1.0:1787790596.842227:0:5841:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787790596.842245:0:5841:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1787790596.864856:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1787790596.877217:0:5841:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787790596.877239:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787790596.877586:0:5862:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787790596.877591:0:5862:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787790596.877608:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000047177286/0x70647b5fa9774012 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790596.877643:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000052d52779/0x70647b5fa9773fe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9773fda expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790596.877650:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000047177286/0x70647b5fa9774012 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790596.877687:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000052d52779/0x70647b5fa9773fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa9773fda expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790596.877701:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000052d52779/0x70647b5fa9773fe1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa9773fda expref: 12 pid: 5841 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790596.877716:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000737cc572 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1874634253273984:0@lo:104: 00000100:00100000:3.0:1787790596.877820:0:5862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790596.877872:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set 0000000052861c0e going to sleep for 11 seconds 00000100:00100000:0.0:1787790596.877872:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253273984 00000100:00100000:0.0:1787790596.877879:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253273984 00000100:00100000:0.0:1787790596.877919:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790596.877927:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e2070b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:5862:x1874634253273984:12345-0@lo:104: 00010000:00010000:0.0:1787790596.877937:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: 00000000cbe85876/0x70647b5fa9773fda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9773fe1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.877996:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787790596.878001:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e2070b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:5862:x1874634253273984:12345-0@lo:104: Request processed in 75us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790596.878016:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787790596.878026:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790596.878031:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: 00000000cbe85876/0x70647b5fa9773fda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9773fe1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.878045:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cbe85876 already unused, calling callback (00000000517c6138) 10000000:00010000:2.0:1787790596.878057:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: 00000000cbe85876/0x70647b5fa9773fda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa9773fe1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.878064:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: 00000000cbe85876/0x70647b5fa9773fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa9773fe1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790596.878069:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: 00000000cbe85876/0x70647b5fa9773fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa9773fe1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790596.878075:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787790596.878109:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: 00000000cbe85876/0x70647b5fa9773fda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9773fe1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.878116:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790596.878142:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: 00000000cbe85876/0x70647b5fa9773fda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9773fe1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.878149:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: 00000000cbe85876/0x70647b5fa9773fda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9773fe1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790596.878164:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790596.878166:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790596.878167:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790596.878199:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f64304fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253274112:0@lo:103: 00000100:00100000:2.0:1787790596.878229:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790596.878289:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253274112 00000100:00100000:0.0:1787790596.878293:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253274112 00010000:00010000:0.0:1787790596.878307:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000052d52779/0x70647b5fa9773fe1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9773fda expref: 13 pid: 5841 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790596.878326:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790596.878331:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f24a2ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:3319:x1874634253274112:12345-0@lo:103: 00010000:00010000:0.0:1787790596.878340:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790596.878350:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000052d52779/0x70647b5fa9773fe1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9773fda expref: 13 pid: 5841 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.878360:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000052d52779/0x70647b5fa9773fe1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa9773fda expref: 13 pid: 5841 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.878374:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000047177286/0x70647b5fa9774012 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.878381:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000047177286/0x70647b5fa9774012 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787790596.878392:0:5831:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000801406s 00010000:00010000:0.0:1787790596.878395:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000047177286/0x70647b5fa9774012 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.878401:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000047177286/0x70647b5fa9774012 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.878407:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000047177286/0x70647b5fa9774012 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.878413:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000047177286/0x70647b5fa9774012 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.878418:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000047177286 already unused, calling callback (00000000eb16bc23) 00010000:00010000:0.0:1787790596.878421:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000047177286/0x70647b5fa9774012 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.878428:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000047177286/0x70647b5fa9774012 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.878436:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000047177286/0x70647b5fa9774012 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790596.878450:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790596.878484:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f24a2ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:3319:x1874634253274112:12345-0@lo:103: Request processed in 153us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790596.878490:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787790596.878639:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f64304fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253274112:0@lo:103: 00010000:00010000:3.0:1787790596.878704:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000052d52779/0x70647b5fa9773fe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa9773fda expref: 12 pid: 5841 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790596.878713:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000737cc572 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1874634253273984:0@lo:104: 00010000:00010000:3.0:1787790596.878756:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000047177286/0x70647b5fa9774012 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790596.878766:0:5862:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000047177286/0x70647b5fa9774012 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790596.878771:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000047177286/0x70647b5fa9774012 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790596.878776:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000047177286/0x70647b5fa9774012 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790596.892158:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066572246 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:5827:x1874634253273856:12345-0@lo:253: Request processed in 49945us (50039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790596.892175:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787790596.892331:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be6f43f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5827:1874634253273856:0@lo:253: 10000000:01000000:2.0:1787790596.892359:0:5827:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787790596.892362:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787790596.892364:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787790596.892365:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787790596.892367:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787790596.892368:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787790596.892369:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787790596.892370:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787790596.892371:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787790596.892373:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787790596.892374:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787790596.892375:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787790596.892376:0:5827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787790596.892390:0:5827:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787790596.898511:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787790596.898824:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787790596.899000:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787790596.900232:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787790596.900438:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787790596.900580:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787790596.905153:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787790596.905361:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787790596.905587:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787790596.905816:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787790596.906062:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787790596.906264:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787790596.973027:0:5827:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787790597.039133:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787790597.040110:0:5879:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787790597.040115:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787790597.043236:0:5880:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787790597.056341:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787790597.056642:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787790597.061387:0:5827:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787790597.061423:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787790597.061676:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787790597.064316:0:5827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787790597.064916:0:5827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787790597.064950:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787790597.065227:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787790597.065399:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1787790597.071186:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787790597.071552:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787790597.071835:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787790597.072189:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787790597.072420:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787790597.072582:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787790597.073147:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787790597.074223:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787790597.074451:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787790597.075298:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787790597.076440:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787790597.076582:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787790597.077705:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787790597.077900:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787790597.078131:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787790597.078292:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787790597.078570:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787790597.078716:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787790597.078916:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787790597.079344:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787790597.079500:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787790597.079636:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787790597.079820:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787790597.079966:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787790597.081945:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787790597.082239:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787790597.082403:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787790597.082541:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787790597.082674:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787790597.084330:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787790597.084513:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787790597.084661:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787790597.084917:0:5827:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1787790597.095949:0:5880:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1787790597.158340:0:5827:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787790597.158381:0:5827:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb49541c7f988 00100000:10000000:0.0:1787790597.158389:0:5827:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787790597.159790:0:5827:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787790597.159807:0:5827:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787790597.159820:0:5827:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787790597.159836:0:5827:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1787790597.213382:0:5880:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787790597.213463:0:5880:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787790597.213467:0:5880:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787790597.887959:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790598.918882:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790599.935879:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790600.964036:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787790601.478324:0:6123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787790601.984120:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787790602.319423:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787790602.319435:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787790602.319438:0:36:0:(import.c:65:import_set_state_nolock()) 0000000081ac778f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787790602.319452:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000081ac778f using connection 192.168.201.125@tcp/0@lo 00000100:00100000:3.0:1787790602.319474:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ffb4e7d1 x1874634253274368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787790602.319522:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ffb4e7d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874634253274368:0@lo:38: 00000100:00100000:3.0:1787790602.319589:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790602.319665:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253274368 00000100:00100000:3.0:1787790602.319672:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253274368 00000100:00100000:3.0:1787790602.319702:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790602.319709:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ceaf33b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3317:x1874634253274368:12345-0@lo:38: 00010000:00080000:3.0:1787790602.319758:0:5848:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 137 last 0 00000020:00000080:3.0:1787790602.319790:0:5848:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x70647b5fa9774019 00000004:00100000:3.0:1787790602.319845:0:5848:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787790602.320002:0:5848:0:(import.c:65:import_set_state_nolock()) 000000001afda1db : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790602.320054:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ceaf33b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874634253274368:12345-0@lo:38: Request processed in 343us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790602.320062:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787790602.320102:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ffb4e7d1 x1874634253274368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787790612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787790602.320116:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787790602.320123:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787790602.320127:0:3317:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787790602.320136:0:3317:0:(import.c:65:import_set_state_nolock()) 0000000081ac778f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787790602.320141:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ffb4e7d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874634253274368:0@lo:38: 00000100:00100000:1.0:1787790602.320693:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f8c58f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253274240:0@lo:400: 00000100:00100000:1.0:1787790602.320755:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790602.321523:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253274240 00000100:00100000:3.0:1787790602.321533:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253274240 00000100:00100000:3.0:1787790602.321576:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787790602.321583:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ff90999 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:3320:x1874634253274240:12345-0@lo:400: 00000100:00100000:3.0:1787790602.321631:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ff90999 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:3320:x1874634253274240:12345-0@lo:400: Request processed in 48us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790602.321638:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787790602.321824:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f8c58f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253274240:0@lo:400: 00010000:00010000:0.0:1787790603.008694:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790604.032071:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787790604.352283:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787790604.352292:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff931a4977d000 from 3 10000000:01000000:1.0:1787790604.352297:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787790604.352343:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 00000000419b195a/0x70647b5fa9774020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790604.352355:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 00000000419b195a/0x70647b5fa9774020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790604.352365:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 00000000419b195a/0x70647b5fa9774020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790604.352388:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059c408d6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253274496:0@lo:101: 00000100:00100000:1.0:1787790604.352463:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790604.352516:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set 0000000082bbe8c7 going to sleep for 11 seconds 00000100:00100000:0.0:1787790604.356107:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253274496 00000100:00100000:0.0:1787790604.356125:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253274496 00000100:00100000:0.0:1787790604.356193:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787790604.356202:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4d340e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:5843:x1874634253274496:12345-0@lo:101: 00010000:00010000:0.0:1787790604.356221:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790604.356241:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006eeaaeb3/0x70647b5fa9774027 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9774020 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790604.356282:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006eeaaeb3/0x70647b5fa9774027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9774020 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790604.356293:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006eeaaeb3/0x70647b5fa9774027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9774020 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790604.356302:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006eeaaeb3, rc 0) 00000100:00100000:0.0:1787790604.356375:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4d340e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:5843:x1874634253274496:12345-0@lo:101: Request processed in 175us (3912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790604.356381:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787790604.356786:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059c408d6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253274496:0@lo:101: 00010000:00010000:1.0:1787790604.356806:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 00000000419b195a/0x70647b5fa9774020 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774027 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790604.356816:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 00000000419b195a/0x70647b5fa9774020 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9774027 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790604.356876:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059c408d6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253274624:0@lo:256: 00000100:00100000:1.0:1787790604.356918:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790604.356975:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set 0000000082bbe8c7 going to sleep for 11 seconds 00000100:00100000:1.0:1787790604.356990:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253274624 00000100:00100000:1.0:1787790604.356994:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253274624 00000100:00100000:1.0:1787790604.357018:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787790604.357024:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6481557 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:5843:x1874634253274624:12345-0@lo:256: 20000000:01000000:1.0:1787790604.357037:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787790604.357052:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787790604.357055:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787790604.357130:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6481557 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:5843:x1874634253274624:12345-0@lo:256: Request processed in 105us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790604.357137:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787790604.357166:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059c408d6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253274624:0@lo:256: 10000000:01000000:1.0:1787790604.357200:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787790604.357206:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 00000000419b195a/0x70647b5fa9774020 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774027 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790604.357214:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 00000000419b195a/0x70647b5fa9774020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774027 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790605.057855:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790606.080307:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787790606.284520:0:6324:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd09498ed0 20000000:00000080:3.0:1787790606.284543:0:6324:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff931a7d84ec00 uarg=0000000000000000 20000000:01000000:3.0:1787790606.284600:0:6324:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787790606.285015:0:6324:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787790606.285021:0:6324:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787790606.285374:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787790606.285388:0:6324:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787790606.288282:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787790606.288858:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787790606.288933:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787790606.288982:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787790606.289003:0:6324:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787790606.289029:0:6324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000602b26fb/0x70647b5fa977402e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790606.289055:0:6324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000970ac13c/0x70647b5fa9773fef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9773fe8 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790606.289064:0:6324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000602b26fb/0x70647b5fa977402e lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790606.289127:0:6324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000970ac13c/0x70647b5fa9773fef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa9773fe8 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790606.289144:0:6324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000970ac13c/0x70647b5fa9773fef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa9773fe8 expref: 11 pid: 5840 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790606.289161:0:6324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d866fcbe pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1874634253274752:0@lo:104: 00000100:00100000:3.0:1787790606.289249:0:6324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790606.289378:0:6324:0:(client.c:2715:ptlrpc_set_wait()) set 00000000567615a4 going to sleep for 11 seconds 00000100:00100000:0.0:1787790606.289952:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253274752 00000100:00100000:0.0:1787790606.289963:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253274752 00000100:00100000:0.0:1787790606.290033:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787790606.290045:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7525892 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:6324:x1874634253274752:12345-0@lo:104: 00010000:00010000:0.0:1787790606.290066:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: 000000007e2a94f4/0x70647b5fa9773fe8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9773fef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790606.290148:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787790606.290153:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7525892 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:6324:x1874634253274752:12345-0@lo:104: Request processed in 113us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790606.290160:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790606.290166:0:6324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d866fcbe pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1874634253274752:0@lo:104: 00010000:00010000:3.0:1787790606.290194:0:6324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000602b26fb/0x70647b5fa977402e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790606.290248:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790606.290256:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: 000000007e2a94f4/0x70647b5fa9773fe8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9773fef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790606.290263:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007e2a94f4 already unused, calling callback (00000000517c6138) 10000000:00010000:2.0:1787790606.290278:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: 000000007e2a94f4/0x70647b5fa9773fe8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa9773fef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790606.290288:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: 000000007e2a94f4/0x70647b5fa9773fe8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa9773fef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790606.290295:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: 000000007e2a94f4/0x70647b5fa9773fe8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa9773fef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790606.290301:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787790606.290387:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: 000000007e2a94f4/0x70647b5fa9773fe8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9773fef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790606.290395:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787790606.290914:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ac72643 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253274880:0@lo:103: 00000100:00100000:1.0:1787790606.290972:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790606.291067:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: 000000007e2a94f4/0x70647b5fa9773fe8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9773fef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790606.291077:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: 000000007e2a94f4/0x70647b5fa9773fe8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9773fef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790606.291096:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790606.291099:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790606.291100:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790606.291268:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253274880 00000100:00100000:0.0:1787790606.291273:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253274880 00010000:00010000:0.0:1787790606.291295:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000970ac13c/0x70647b5fa9773fef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9773fe8 expref: 12 pid: 5840 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790606.291320:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787790606.291338:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059c408d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:3321:x1874634253274880:12345-0@lo:103: 00010000:00010000:0.0:1787790606.291503:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790606.291510:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000970ac13c/0x70647b5fa9773fef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9773fe8 expref: 12 pid: 5840 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790606.291522:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000970ac13c/0x70647b5fa9773fef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa9773fe8 expref: 12 pid: 5840 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790606.291541:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000970ac13c/0x70647b5fa9773fef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa9773fe8 expref: 12 pid: 5840 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790606.291557:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000602b26fb/0x70647b5fa977402e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790606.291566:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000602b26fb/0x70647b5fa977402e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790606.291584:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000602b26fb/0x70647b5fa977402e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790606.291592:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000602b26fb/0x70647b5fa977402e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790606.291597:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000602b26fb/0x70647b5fa977402e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790606.291604:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000602b26fb/0x70647b5fa977402e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790606.291610:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000602b26fb already unused, calling callback (00000000eb16bc23) 00010000:00010000:0.0:1787790606.291613:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000602b26fb/0x70647b5fa977402e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790606.291955:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000602b26fb/0x70647b5fa977402e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790606.291978:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000602b26fb/0x70647b5fa977402e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790606.291991:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790606.292046:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059c408d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:3321:x1874634253274880:12345-0@lo:103: Request processed in 711us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790606.292056:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787790606.292153:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ac72643 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253274880:0@lo:103: 00010000:00010000:3.0:1787790606.292220:0:6324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000602b26fb/0x70647b5fa977402e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790606.292230:0:6324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000602b26fb/0x70647b5fa977402e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790606.292236:0:6324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000602b26fb/0x70647b5fa977402e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790607.104066:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790607.426074:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be6f43f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874634253275136:0@lo:400: 00000100:00100000:0.0:1787790607.426187:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790607.426273:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790607.426279:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006c9b0352 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253275008:0@lo:400: 00000100:00100000:0.0:1787790607.426310:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790607.426364:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253275008 00000100:00100000:0.0:1787790607.426373:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253275008 00000100:00100000:0.0:1787790607.426441:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787790607.426451:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c0130b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:3319:x1874634253275008:12345-0@lo:400: 00000100:00100000:0.0:1787790607.426527:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c0130b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:3319:x1874634253275008:12345-0@lo:400: Request processed in 78us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790607.426534:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787790607.427181:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253275136 00000100:00100000:3.0:1787790607.427189:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253275136 00000100:00100000:3.0:1787790607.427248:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787790607.427258:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e1d524e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874634253275136:12345-0@lo:400: 00000100:00100000:3.0:1787790607.427327:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e1d524e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874634253275136:12345-0@lo:400: Request processed in 61us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790607.427340:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790607.433009:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006c9b0352 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253275008:0@lo:400: 00010000:00080000:0.0:1787790607.433041:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000be6f43f8 x1874634253275136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790607.433057:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be6f43f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874634253275136:0@lo:400: 00010000:00010000:2.0:1787790608.128510:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790609.152871:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787790609.475173:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787790609.475181:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff931a4977d000 from 1 10000000:01000000:1.0:1787790609.475186:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787790609.475230:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 000000001049328a/0x70647b5fa9774035 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790609.475242:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 000000001049328a/0x70647b5fa9774035 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790609.475260:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 000000001049328a/0x70647b5fa9774035 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790609.475287:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002989794b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253275264:0@lo:101: 00000100:00100000:1.0:1787790609.475356:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790609.476208:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set 00000000963bd689 going to sleep for 11 seconds 00000100:00100000:3.0:1787790609.477246:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253275264 00000100:00100000:3.0:1787790609.477256:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253275264 00000100:00100000:3.0:1787790609.477351:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787790609.477360:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005207d4fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:5843:x1874634253275264:12345-0@lo:101: 00010000:00010000:3.0:1787790609.477378:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790609.477414:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000602b26fb/0x70647b5fa977403c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9774035 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790609.477440:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000602b26fb/0x70647b5fa977403c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9774035 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790609.477451:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000602b26fb/0x70647b5fa977403c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9774035 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790609.477460:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000602b26fb, rc 0) 00000100:00100000:3.0:1787790609.477533:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005207d4fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:5843:x1874634253275264:12345-0@lo:101: Request processed in 175us (2177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790609.477541:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787790609.477619:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002989794b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253275264:0@lo:101: 00010000:00010000:2.0:1787790609.477636:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 000000001049328a/0x70647b5fa9774035 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977403c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790609.477645:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 000000001049328a/0x70647b5fa9774035 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa977403c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790609.477738:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041fcc838 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253275392:0@lo:501: 00000100:00100000:2.0:1787790609.477772:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790609.486580:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set 000000008c905877 going to sleep for 11 seconds 00000100:00100000:1.0:1787790609.486788:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253275392 00000100:00100000:1.0:1787790609.486798:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253275392 00000100:00100000:1.0:1787790609.486856:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787790609.486866:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5196a94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:5843:x1874634253275392:12345-0@lo:501: 00000100:00100000:1.0:1787790609.487503:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5196a94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:5843:x1874634253275392:12345-0@lo:501: Request processed in 636us (9728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790609.487513:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787790609.490889:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041fcc838 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253275392:0@lo:501: 00000100:00100000:2.0:1787790609.490967:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041fcc838 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253275520:0@lo:503: 00000100:00100000:2.0:1787790609.491526:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790609.491630:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set 000000008c905877 going to sleep for 11 seconds 00000100:00100000:1.0:1787790609.495854:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253275520 00000100:00100000:1.0:1787790609.495868:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253275520 00000100:00100000:1.0:1787790609.495972:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787790609.495982:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1a0d0ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:5843:x1874634253275520:12345-0@lo:503: 00000100:00100000:1.0:1787790609.497384:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1a0d0ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:5843:x1874634253275520:12345-0@lo:503: Request processed in 1400us (5856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790609.497462:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787790609.497467:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041fcc838 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253275520:0@lo:503: 00000100:00100000:3.0:1787790609.497687:0:6541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d866fcbe pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6541:1874634253275648:0@lo:502: 00000100:00100000:3.0:1787790609.497749:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790609.503373:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253275648 00000100:00100000:2.0:1787790609.503388:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253275648 00000100:00100000:2.0:1787790609.503453:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787790609.503462:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d34cd8ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:6541:x1874634253275648:12345-0@lo:502: 00000100:00100000:2.0:1787790609.503826:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d34cd8ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:6541:x1874634253275648:12345-0@lo:502: Request processed in 364us (6077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790609.503846:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787790609.505348:0:6541:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b14ade78 going to sleep for 11 seconds 00000100:00100000:2.0:1787790609.505386:0:6541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d866fcbe pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6541:1874634253275648:0@lo:502: 00000020:01000000:2.0:1787790609.505497:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790609.505508:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790609.505510:0:6541:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787790609.505517:0:6541:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff931a4977d000 00000020:00000080:2.0:1787790609.505519:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787790609.505575:0:6541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6541:1874634253275776:0@lo:502: 00000100:00100000:2.0:1787790609.505638:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790609.505670:0:6541:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a450fe3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790609.505788:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253275776 00000100:00100000:1.0:1787790609.505794:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253275776 00000100:00100000:1.0:1787790609.505846:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787790609.505855:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45660050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:6541:x1874634253275776:12345-0@lo:502: 00000100:00100000:1.0:1787790609.506190:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45660050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:6541:x1874634253275776:12345-0@lo:502: Request processed in 335us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790609.506208:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787790609.506311:0:6541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6541:1874634253275776:0@lo:502: 00000020:01000000:2.0:1787790609.506338:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790609.506342:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790609.506344:0:6541:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787790609.506347:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787790609.506670:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787790609.506687:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787790609.506696:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a41478e00/0x70647b5fa9774035 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977403c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790609.506707:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a41478e00/0x70647b5fa9774035 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977403c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790610.185909:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790611.202564:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790612.228084:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790612.551736:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253276032:0@lo:400: 00000100:00100000:1.0:1787790612.551862:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790612.551957:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787790612.551964:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253275904:0@lo:400: 00000100:00100000:1.0:1787790612.552004:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790612.552042:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253275904 00000100:00100000:1.0:1787790612.552053:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253275904 00000100:00100000:3.0:1787790612.552260:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253276032 00000100:00100000:3.0:1787790612.552265:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253276032 00000100:00100000:3.0:1787790612.552311:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790612.552324:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253276032:12345-0@lo:400: 00000100:00100000:3.0:1787790612.552407:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253276032:12345-0@lo:400: Request processed in 85us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790612.552445:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787790612.552511:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff931a45dbf840 x1874634253276032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790612.552530:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253276032:0@lo:400: 00000100:00100000:3.0:1787790612.552845:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787790612.552854:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:3321:x1874634253275904:12345-0@lo:400: 00000100:00100000:3.0:1787790612.552903:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:3321:x1874634253275904:12345-0@lo:400: Request processed in 51us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790612.552910:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787790612.552997:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253275904:0@lo:400: 00000020:01000004:3.0:1787790613.084246:0:6681:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787790613.084252:0:6681:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787790613.084429:0:6681:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff931a493ae800 00000020:01000004:3.0:1787790613.084453:0:6681:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787790613.084469:0:6681:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787790613.084486:0:6681:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff931a493c4d28) 00000020:00000080:3.0:1787790613.084506:0:6681:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787790613.147589:0:6681:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787790613.148587:0:6681:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787790613.204880:0:6681:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787790613.215942:0:6681:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787790613.215993:0:6681:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787790613.216058:0:6681:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787790613.216085:0:6681:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787790613.217003:0:6681:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787790613.217018:0:6681:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787790613.217032:0:6681:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x70647b5fa977404a 00000020:01000004:1.0:1787790613.217043:0:6681:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1787790613.217071:0:6681:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.125@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787790613.217091:0:6681:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787790613.217100:0:6681:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787790613.217106:0:6681:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787790613.217135:0:6681:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff931a7dc9b370) 00000020:00000080:1.0:1787790613.217149:0:6681:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1787790613.218694:0:6681:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787790613.218943:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787790613.218950:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787790613.223058:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787790613.223076:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787790613.223714:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787790613.223754:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787790613.225508:0:6681:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787790613.225796:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787790613.225804:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787790613.235668:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787790613.235685:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:2.0:1787790613.248018:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790613.270248:0:6681:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787790613.270571:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787790613.270579:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787790613.284860:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787790613.284883:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787790613.290862:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787790613.290885:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787790613.296191:0:6681:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787790613.296529:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787790613.296538:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787790613.299095:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787790613.299109:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787790613.384919:0:6681:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787790613.385656:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787790613.385677:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787790613.387107:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787790613.387121:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787790613.396854:0:6681:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787790613.397051:0:6681:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787790613.397062:0:6681:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.125@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787790613.432316:0:6681:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787790613.432560:0:6681:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.125@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1787790613.432565:0:6681:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787790613.432567:0:6681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787790613.432568:0:6681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790613.432570:0:6681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790613.432572:0:6681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790613.432573:0:6681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790613.432575:0:6681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787790613.432576:0:6681:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787790613.432578:0:6681:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787790613.432580:0:6681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790613.432582:0:6681:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787790613.432587:0:6681:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1787790613.432589:0:6681:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787790613.432591:0:6681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787790613.432592:0:6681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790613.432593:0:6681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790613.432594:0:6681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790613.432596:0:6681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790613.432597:0:6681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787790613.432603:0:6681:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787790613.432604:0:6681:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787790613.432605:0:6681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790613.432606:0:6681:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787790613.432642:0:6681:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787790613.432668:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253276160:0@lo:253: 00000100:00100000:1.0:1787790613.432996:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790613.433099:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b64ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790613.437209:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253276160 00000100:00100000:0.0:1787790613.437228:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253276160 00000100:00100000:0.0:1787790613.437310:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787790613.437320:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:6681:x1874634253276160:12345-0@lo:253: 20000000:01000000:0.0:1787790613.437375:0:5841:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787790613.437380:0:5841:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787790613.437386:0:5841:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787790613.437391:0:5841:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1787790613.439189:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787790613.439429:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1787790613.439444:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1787790613.439487:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1787790613.439495:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1787790613.439526:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1787790613.439575:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1787790613.440025:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1787790613.440050:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.125@tcp 20000000:01000000:3.0:1787790613.440052:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.125@tcp (null) (null) (null) 00000040:00080000:3.0:1787790613.440088:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1787790613.440096:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787790613.440144:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1787790613.440152:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.125@tcp (null) (null) 00000040:00080000:3.0:1787790613.440183:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1787790613.440192:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787790613.440216:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1787790613.440260:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1787790613.441017:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1787790613.441037:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.125@tcp 20000000:01000000:3.0:1787790613.441039:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.125@tcp (null) (null) (null) 00000040:00080000:3.0:1787790613.441073:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1787790613.441082:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787790613.441115:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787790613.441122:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.125@tcp (null) (null) 00000040:00080000:3.0:1787790613.441167:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787790613.441177:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787790613.441228:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1787790613.441287:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1787790613.441305:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787790613.441309:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787790613.441317:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787790613.441319:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787790613.441322:0:5841:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787790613.441341:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787790613.441344:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787790613.441384:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787790613.441387:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787790613.447914:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1787790613.448396:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1787790613.448455:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1787790613.448541:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1787790613.448560:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787790613.448563:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787790613.449289:0:6697:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1787790613.449366:0:6697:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1787790613.449444:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787790613.449798:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787790613.449833:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787790613.449885:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787790613.449897:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787790613.449900:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787790613.450432:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1787790613.450480:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1787790613.450530:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787790613.450878:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787790613.450920:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787790613.450975:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:1.0:1787790613.450997:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787790613.451025:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff931a41479000/0x70647b5fa9774058 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.451048:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a542f0000/0x70647b5fa9773f71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9773f6a expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.451056:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a52848400/0x70647b5fa9773f8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9773f86 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.451063:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a542f1200/0x70647b5fa9773ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9773ff6 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.451083:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff931a41479000/0x70647b5fa9774058 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.451137:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a542f1200/0x70647b5fa9773ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa9773ff6 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.451156:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a542f1200/0x70647b5fa9773ffd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa9773ff6 expref: 12 pid: 5840 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790613.451175:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874634253276288:0@lo:104: 00000100:00100000:1.0:1787790613.451270:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790613.451407:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a52848400/0x70647b5fa9773f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa9773f86 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.451417:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a52848400/0x70647b5fa9773f8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa9773f86 expref: 12 pid: 5841 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790613.451426:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874634253276416:0@lo:104: 00000100:00100000:1.0:1787790613.451450:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790613.451478:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a542f0000/0x70647b5fa9773f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa9773f6a expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.451487:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a542f0000/0x70647b5fa9773f71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa9773f6a expref: 12 pid: 5838 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790613.451496:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874634253276544:0@lo:104: 00000100:00100000:1.0:1787790613.451516:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790613.451525:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b64a180 going to sleep for 11 seconds 00000100:00100000:0.0:1787790613.451609:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253276288 00000100:00100000:0.0:1787790613.451618:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253276288 00000100:00100000:0.0:1787790613.451662:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253276416 00000100:00100000:0.0:1787790613.451665:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253276416 00000100:00100000:0.0:1787790613.451676:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253276544 00000100:00100000:0.0:1787790613.451679:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253276544 00000100:00100000:0.0:1787790613.451693:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787790613.451702:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+5:5841:x1874634253276288:12345-0@lo:104: 00010000:00010000:0.0:1787790613.451717:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9773ff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9773ffd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.451832:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787790613.451838:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+5:5841:x1874634253276288:12345-0@lo:104: Request processed in 137us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790613.451847:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787790613.451866:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787790613.451872:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+4:5841:x1874634253276416:12345-0@lo:104: 00010000:00010000:0.0:1787790613.451880:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa9773f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9773f8d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.451928:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787790613.451934:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+4:5841:x1874634253276416:12345-0@lo:104: Request processed in 62us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790613.451941:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787790613.451953:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787790613.451958:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:5841:x1874634253276544:12345-0@lo:104: 00010000:00010000:0.0:1787790613.451966:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a41479800/0x70647b5fa9773f6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9773f71 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.451990:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787790613.451994:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:5841:x1874634253276544:12345-0@lo:104: Request processed in 37us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790613.452000:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787790613.452017:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787790613.452024:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9773ff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9773ffd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.452032:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40031c00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:0.0:1787790613.452037:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9773ff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa9773ffd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.452047:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9773ff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa9773ffd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790613.452056:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9773ff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa9773ffd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790613.452063:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787790613.452107:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9773ff6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9773ffd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.452114:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790613.452137:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9773ff6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9773ffd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.452145:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9773ff6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9773ffd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.452161:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787790613.452165:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa9773f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9773f8d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.452171:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479e00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:0.0:1787790613.452174:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa9773f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa9773f8d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.452181:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa9773f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa9773f8d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790613.452188:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa9773f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa9773f8d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790613.452193:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787790613.452204:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa9773f86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9773f8d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.452210:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790613.452215:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa9773f86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9773f8d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.452233:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa9773f86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9773f8d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.452243:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790613.452246:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a41479800/0x70647b5fa9773f6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9773f71 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.452252:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479800 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:0.0:1787790613.452255:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a41479800/0x70647b5fa9773f6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa9773f71 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.452262:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a41479800/0x70647b5fa9773f6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa9773f71 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790613.452269:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a41479800/0x70647b5fa9773f6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa9773f71 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790613.452274:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787790613.452288:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a41479800/0x70647b5fa9773f6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9773f71 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.452294:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790613.452311:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a41479800/0x70647b5fa9773f6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9773f71 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.452318:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a41479800/0x70647b5fa9773f6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9773f71 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790613.452452:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874634253276288:0@lo:104: 00000100:00100000:1.0:1787790613.452469:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874634253276416:0@lo:104: 00000100:00100000:1.0:1787790613.452476:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874634253276544:0@lo:104: 00010000:00010000:1.0:1787790613.452506:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff931a41479000/0x70647b5fa9774058 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.452558:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790613.452565:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790613.452567:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790613.452594:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253276672:0@lo:103: 00000100:00100000:0.0:1787790613.452633:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790613.452676:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787790613.452683:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253276800:0@lo:103: 00000100:00100000:0.0:1787790613.452703:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790613.452771:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253276928:0@lo:103: 00000100:00100000:0.0:1787790613.452795:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790613.452832:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253276672 00000100:00100000:0.0:1787790613.452837:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253276672 00010000:00010000:0.0:1787790613.452861:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a542f1200/0x70647b5fa9773ffd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9773ff6 expref: 13 pid: 5840 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790613.452879:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253276800 00000100:00100000:0.0:1787790613.452881:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253276800 00010000:00010000:0.0:1787790613.452890:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a52848400/0x70647b5fa9773f8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9773f86 expref: 14 pid: 5841 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790613.452899:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253276928 00000100:00100000:0.0:1787790613.452901:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253276928 00010000:00010000:0.0:1787790613.452910:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a542f0000/0x70647b5fa9773f71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9773f6a expref: 15 pid: 5838 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790613.452923:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787790613.452930:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ee83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:3318:x1874634253276672:12345-0@lo:103: 00010000:00010000:0.0:1787790613.452942:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790613.452947:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a542f1200/0x70647b5fa9773ffd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9773ff6 expref: 15 pid: 5840 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.452969:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a542f1200/0x70647b5fa9773ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa9773ff6 expref: 15 pid: 5840 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.452984:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a542f1200/0x70647b5fa9773ffd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa9773ff6 expref: 15 pid: 5840 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.452999:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790613.453029:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ee83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:3318:x1874634253276672:12345-0@lo:103: Request processed in 101us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790613.453036:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787790613.453050:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787790613.453056:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ee9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:3318:x1874634253276800:12345-0@lo:103: 00010000:00010000:0.0:1787790613.453064:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790613.453068:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a52848400/0x70647b5fa9773f8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9773f86 expref: 13 pid: 5841 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.453076:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a52848400/0x70647b5fa9773f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa9773f86 expref: 13 pid: 5841 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.453086:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a52848400/0x70647b5fa9773f8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa9773f86 expref: 13 pid: 5841 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.453096:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790613.453118:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ee9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:3318:x1874634253276800:12345-0@lo:103: Request processed in 63us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790613.453123:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787790613.453134:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787790613.453140:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ee9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:3320:x1874634253276928:12345-0@lo:103: 00010000:00010000:0.0:1787790613.453152:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790613.453157:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a542f0000/0x70647b5fa9773f71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9773f6a expref: 11 pid: 5838 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.453166:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a542f0000/0x70647b5fa9773f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa9773f6a expref: 11 pid: 5838 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.453175:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a542f0000/0x70647b5fa9773f71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa9773f6a expref: 11 pid: 5838 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.453187:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff931a41479000/0x70647b5fa9774058 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.453195:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a41479000/0x70647b5fa9774058 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.453210:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a41479000/0x70647b5fa9774058 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.453217:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a41479000/0x70647b5fa9774058 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.453223:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff931a41479000/0x70647b5fa9774058 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.453229:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff931a41479000/0x70647b5fa9774058 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.453234:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479000 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:0.0:1787790613.453238:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff931a41479000/0x70647b5fa9774058 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.453255:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff931a41479000/0x70647b5fa9774058 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.453271:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff931a41479000/0x70647b5fa9774058 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.453279:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790613.453305:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ee9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+10:3320:x1874634253276928:12345-0@lo:103: Request processed in 165us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790613.453311:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787790613.453560:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790613.454485:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253276928:0@lo:103: 00000100:00100000:0.0:1787790613.454530:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253276800:0@lo:103: 00000100:00100000:0.0:1787790613.454540:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253276672:0@lo:103: 00010000:00010000:0.0:1787790613.454567:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff931a41479000/0x70647b5fa9774058 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.454576:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff931a41479000/0x70647b5fa9774058 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.454583:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a41479000/0x70647b5fa9774058 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787790613.454603:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787790613.534039:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+9:6681:x1874634253276160:12345-0@lo:253: Request processed in 96706us (101030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790613.534060:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787790613.534213:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253276160:0@lo:253: 10000000:01000000:1.0:1787790613.534235:0:6681:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787790613.534240:0:6681:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787790613.534242:0:6681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787790613.534243:0:6681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790613.534244:0:6681:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787790613.534246:0:6681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790613.534247:0:6681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790613.534249:0:6681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787790613.534251:0:6681:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787790613.534253:0:6681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790613.534254:0:6681:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787790613.534283:0:6681:0:(tgt_mount.c:101:server_register_mount()) register mount ffff931a493ae800 from lustre-OST0000 10000000:01000000:1.0:1787790613.534314:0:6681:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787790613.534317:0:6681:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787790613.534340:0:6681:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff931a44ec4d28 local copy 10000000:01000000:1.0:1787790613.534345:0:6681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787790613.534395:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a41479200/0x70647b5fa977405f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.534408:0:6681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.125@tcp lock: ffff931a41479200/0x70647b5fa977405f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.534419:0:6681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a41479200/0x70647b5fa977405f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790613.534443:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253277056:0@lo:101: 00000100:00100000:1.0:1787790613.534506:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790613.534582:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253277056 00000100:00100000:1.0:1787790613.534583:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b64ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790613.534600:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253277056 00000100:00100000:3.0:1787790613.534671:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787790613.534686:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45662050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+9:6681:x1874634253277056:12345-0@lo:101: 00010000:00010000:3.0:1787790613.534703:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790613.535132:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a52848c00/0x70647b5fa9774066 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa977405f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790613.535921:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a52848c00/0x70647b5fa9774066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa977405f expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790613.535941:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a52848c00/0x70647b5fa9774066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa977405f expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790613.535954:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a52848c00, rc 0) 00000100:00100000:2.0:1787790613.536044:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45662050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+10:6681:x1874634253277056:12345-0@lo:101: Request processed in 1362us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790613.536068:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787790613.537015:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253277056:0@lo:101: 00010000:00010000:1.0:1787790613.537042:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a41479200/0x70647b5fa977405f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x70647b5fa9774066 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.537054:0:6681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a41479200/0x70647b5fa977405f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x70647b5fa9774066 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790613.537240:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253277184:0@lo:501: 00000100:00100000:1.0:1787790613.537296:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790613.537354:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b64ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790613.538019:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253277184 00000100:00100000:2.0:1787790613.538028:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253277184 00000100:00100000:2.0:1787790613.538100:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787790613.538112:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45663050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+10:6681:x1874634253277184:12345-0@lo:501: 00000100:00100000:2.0:1787790613.538438:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45663050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+10:6681:x1874634253277184:12345-0@lo:501: Request processed in 327us (1140us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787790613.538447:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787790613.540367:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253277184:0@lo:501: 10000000:01000000:1.0:1787790613.540408:0:6681:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787790613.540485:0:6681:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787790613.540497:0:6681:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a41479200/0x70647b5fa977405f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x70647b5fa9774066 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.540511:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a41479200/0x70647b5fa977405f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x70647b5fa9774066 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.540517:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff931a41479200/0x70647b5fa977405f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x70647b5fa9774066 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.540552:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787790613.540587:0:6681:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff931a493ae800 10000000:01000000:1.0:1787790613.540594:0:6681:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787790613.540601:0:6681:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff931a44ec4d28 10000000:01000000:1.0:1787790613.540621:0:6681:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787790613.540626:0:6681:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff931a44ec4d28 from 1 10000000:01000000:1.0:1787790613.540629:0:6681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787790613.540673:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a41478a00/0x70647b5fa977406d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.540682:0:6681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a41478a00/0x70647b5fa977406d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.540694:0:6681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a41478a00/0x70647b5fa977406d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790613.540717:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253277312:0@lo:101: 00000100:00100000:1.0:1787790613.540849:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790613.540893:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b64a180 going to sleep for 11 seconds 00010000:00010000:0.0:1787790613.540980:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790613.540989:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a41479200/0x70647b5fa977405f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x70647b5fa9774066 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.540997:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479200 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:0.0:1787790613.541009:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a41479200/0x70647b5fa977405f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x70647b5fa9774066 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.541018:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a41479200/0x70647b5fa977405f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x70647b5fa9774066 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790613.541026:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a41479200/0x70647b5fa977405f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x70647b5fa9774066 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790613.541033:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787790613.541059:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a41479200/0x70647b5fa977405f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x70647b5fa9774066 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.541067:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790613.541099:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a41479200/0x70647b5fa977405f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x70647b5fa9774066 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.541107:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a41479200/0x70647b5fa977405f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x70647b5fa9774066 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.541125:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790613.541126:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790613.541128:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790613.541139:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790613.541152:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253277440:0@lo:103: 00000100:00100000:0.0:1787790613.541189:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790613.541227:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253277440 00000100:00100000:0.0:1787790613.541234:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253277440 00000100:00100000:0.0:1787790613.541287:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790613.541296:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ee8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+10:3320:x1874634253277440:12345-0@lo:103: 00010000:00010000:0.0:1787790613.541310:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790613.541333:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a52848c00/0x70647b5fa9774066 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70647b5fa977405f expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.541352:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790613.541389:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ee8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+9:3320:x1874634253277440:12345-0@lo:103: Request processed in 93us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790613.541397:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790613.541431:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253277440:0@lo:103: 00000100:00100000:3.0:1787790613.541628:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253277312 00000100:00100000:3.0:1787790613.541633:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253277312 00000100:00100000:3.0:1787790613.541671:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787790613.541679:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45663850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+9:6681:x1874634253277312:12345-0@lo:101: 00010000:00010000:3.0:1787790613.541694:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790613.541708:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a52849800/0x70647b5fa9774074 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa977406d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790613.541771:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a52849800/0x70647b5fa9774074 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa977406d expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790613.541796:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a52849800/0x70647b5fa9774074 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa977406d expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790613.541804:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a52849800, rc 0) 00000100:00100000:3.0:1787790613.541838:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45663850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+10:6681:x1874634253277312:12345-0@lo:101: Request processed in 161us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790613.541845:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787790613.542164:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253277312:0@lo:101: 00010000:00010000:1.0:1787790613.542180:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a41478a00/0x70647b5fa977406d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774074 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.542190:0:6681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a41478a00/0x70647b5fa977406d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9774074 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790613.542210:0:6681:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787790613.542224:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a41478a00/0x70647b5fa977406d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774074 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.542232:0:6681:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a41478a00/0x70647b5fa977406d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774074 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790613.542241:0:6681:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787790613.542253:0:6681:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787790613.542261:0:6681:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787790613.542264:0:6681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787790613.542289:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa977407b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.542297:0:6681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa977407b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.542305:0:6681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa977407b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790613.542332:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253277568:0@lo:101: 00000100:00100000:1.0:1787790613.542367:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790613.542432:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b64a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787790613.546230:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253277568 00000100:00100000:3.0:1787790613.546250:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253277568 00000100:00100000:2.0:1787790613.547134:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787790613.547150:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45662850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+10:6681:x1874634253277568:12345-0@lo:101: 00010000:00010000:2.0:1787790613.547175:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790613.547202:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a542f1e00/0x70647b5fa9774082 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa977407b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790613.547242:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a542f1e00/0x70647b5fa9774082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa977407b expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790613.547256:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a542f1e00/0x70647b5fa9774082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa977407b expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790613.547266:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f1e00, rc 0) 00000100:00100000:2.0:1787790613.547440:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45662850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:6681:x1874634253277568:12345-0@lo:101: Request processed in 292us (5071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790613.547448:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787790613.547550:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253277568:0@lo:101: 00010000:00010000:3.0:1787790613.547575:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa977407b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774082 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790613.547586:0:6681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa977407b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9774082 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790613.548024:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253277696:0@lo:501: 00000100:00100000:3.0:1787790613.548071:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790613.548194:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253277696 00000100:00100000:0.0:1787790613.548203:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253277696 00000100:00100000:0.0:1787790613.548242:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787790613.548250:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45661050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:6681:x1874634253277696:12345-0@lo:501: 00000100:00100000:3.0:1787790613.548311:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4a0abd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790613.548612:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45661050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:6681:x1874634253277696:12345-0@lo:501: Request processed in 361us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790613.548621:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787790613.548679:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253277696:0@lo:501: 00000100:00100000:3.0:1787790613.548715:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253277824:0@lo:503: 00000100:00100000:3.0:1787790613.548797:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790613.551857:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253277824 00000100:00100000:2.0:1787790613.551878:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253277824 00000100:00100000:3.0:1787790613.551961:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4a0abd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787790613.552024:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787790613.552033:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45662450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:6681:x1874634253277824:12345-0@lo:503: 00000100:00100000:2.0:1787790613.552318:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45662450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:6681:x1874634253277824:12345-0@lo:503: Request processed in 284us (3519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790613.552327:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787790613.552872:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253277824:0@lo:503: 00000040:00080000:3.0:1787790613.553209:0:6681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787790613.553304:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253277952:0@lo:502: 00000100:00100000:3.0:1787790613.553401:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790613.553478:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4a0abd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790613.553933:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253277952 00000100:00100000:0.0:1787790613.553940:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253277952 00000100:00100000:0.0:1787790613.553985:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787790613.553994:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:6681:x1874634253277952:12345-0@lo:502: 00000100:00100000:0.0:1787790613.554258:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:6681:x1874634253277952:12345-0@lo:502: Request processed in 264us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790613.554265:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787790613.554527:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253277952:0@lo:502: 00000040:00080000:3.0:1787790613.555090:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787790613.555153:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787790613.555186:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787790613.555230:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787790613.555266:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787790613.555295:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787790613.555828:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253278080:0@lo:502: 00000100:00100000:3.0:1787790613.555912:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790613.555966:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4a0abd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787790613.556951:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253278080 00000100:00100000:2.0:1787790613.556965:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253278080 00000100:00100000:2.0:1787790613.557090:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787790613.557101:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:6681:x1874634253278080:12345-0@lo:502: 00000100:00100000:2.0:1787790613.557414:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:6681:x1874634253278080:12345-0@lo:502: Request processed in 314us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790613.557423:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787790613.557450:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253278080:0@lo:502: 00000040:00080000:3.0:1787790613.557629:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787790613.557646:0:6681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1787790613.558612:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787790613.558625:0:6699:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787790613.558634:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790613.558637:0:6699:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787790613.558641:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787790613.558659:0:6699:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff931a493c0000) 00000020:00000080:3.0:1787790613.558680:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787790613.558685:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787790613.558850:0:6699:0:(tgt_mount.c:153:server_get_mount()) get mount ffff931a493ae800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787790613.558860:0:6699:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787790613.558869:0:6699:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x70647b5fa9774090 00010000:00010000:2.0:1787790613.563258:0:6699:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1787790613.565605:0:6699:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787790613.573614:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787790613.575087:0:6699:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1787790613.590005:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787790613.590658:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1787790613.599501:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787790613.599519:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787790613.599528:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790613.599530:0:6699:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787790613.599534:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787790613.599539:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790613.599541:0:6699:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787790613.599544:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787790613.599546:0:6699:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787790613.599635:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787790613.599639:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790613.599641:0:6699:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787790613.599644:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787790613.599937:0:6681:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787790613.599970:0:6681:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787790613.599997:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa977407b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774082 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.600012:0:6681:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa977407b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774082 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790613.600029:0:6681:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff931a493ae800 from 1 10000000:01000000:0.0:1787790613.600033:0:6681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787790613.600080:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9774097 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.600089:0:6681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9774097 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.600102:0:6681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9774097 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790613.600133:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253278208:0@lo:101: 00000100:00100000:0.0:1787790613.600226:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790613.600292:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b9f6480 going to sleep for 11 seconds 00000100:00100000:2.0:1787790613.602038:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253278208 00000100:00100000:2.0:1787790613.602056:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253278208 00000100:00100000:2.0:1787790613.602123:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787790613.602135:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:6681:x1874634253278208:12345-0@lo:101: 00010000:00010000:2.0:1787790613.602154:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790613.602174:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a542f1800/0x70647b5fa977409e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9774097 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790613.602206:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a542f1800/0x70647b5fa977409e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9774097 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790613.602218:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a542f1800/0x70647b5fa977409e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9774097 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790613.602243:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f1800, rc 0) 00000100:00100000:3.0:1787790613.602407:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253278208:0@lo:101: 00010000:00010000:3.0:1787790613.602438:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9774097 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977409e expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790613.602451:0:6681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9774097 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa977409e expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790613.602632:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253278336:0@lo:501: 00000100:00100000:3.0:1787790613.603860:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790613.603959:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4a0abe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787790613.605170:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253278336 00000100:00100000:1.0:1787790613.605186:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253278336 00000100:00100000:1.0:1787790613.605258:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787790613.605270:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:6681:x1874634253278336:12345-0@lo:501: 00000100:00100000:1.0:1787790613.605915:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:6681:x1874634253278336:12345-0@lo:501: Request processed in 645us (2057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790613.605925:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787790613.606502:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:6681:x1874634253278208:12345-0@lo:101: Request processed in 4359us (6265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790613.606517:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787790613.608215:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253278336:0@lo:501: 00000100:00100000:2.0:1787790613.608282:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53cce940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253278464:0@lo:503: 00000100:00100000:2.0:1787790613.608510:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790613.608561:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67cd1480 going to sleep for 11 seconds 00000100:00100000:1.0:1787790613.608714:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253278464 00000100:00100000:1.0:1787790613.608767:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253278464 00000100:00100000:1.0:1787790613.608843:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787790613.608854:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:6681:x1874634253278464:12345-0@lo:503: 00000100:00100000:1.0:1787790613.609207:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:6681:x1874634253278464:12345-0@lo:503: Request processed in 354us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790613.609220:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787790613.609260:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53cce940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253278464:0@lo:503: 00000040:00080000:2.0:1787790613.609684:0:6681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787790613.609804:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53cce940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253278592:0@lo:502: 00000100:00100000:2.0:1787790613.609870:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790613.609938:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253278592 00000100:00100000:2.0:1787790613.609941:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67cd1480 going to sleep for 11 seconds 00000100:00100000:1.0:1787790613.609949:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253278592 00000100:00100000:1.0:1787790613.609995:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787790613.610006:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:6681:x1874634253278592:12345-0@lo:502: 00000100:00100000:1.0:1787790613.610205:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:6681:x1874634253278592:12345-0@lo:502: Request processed in 201us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790613.610213:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787790613.610836:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53cce940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253278592:0@lo:502: 00000040:00080000:2.0:1787790613.611158:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787790613.611223:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787790613.611255:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53cce940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253278720:0@lo:502: 00000100:00100000:2.0:1787790613.611314:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790613.611785:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67cd1480 going to sleep for 11 seconds 00000100:00100000:1.0:1787790613.611790:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253278720 00000100:00100000:1.0:1787790613.611804:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253278720 00000100:00100000:1.0:1787790613.611868:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787790613.611878:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:6681:x1874634253278720:12345-0@lo:502: 00000100:00100000:1.0:1787790613.612131:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:6681:x1874634253278720:12345-0@lo:502: Request processed in 254us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790613.612142:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787790613.612181:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53cce940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253278720:0@lo:502: 00000040:00080000:2.0:1787790613.612338:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787790613.612350:0:6681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787790613.613312:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790613.613393:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790613.613406:0:6704:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787790613.613414:0:6704:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff931a493ae800 00000020:00000080:2.0:1787790613.613417:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787790613.613443:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790613.613447:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790613.613448:0:6704:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787790613.613451:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787790613.613515:0:6681:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787790613.613573:0:6681:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787790613.613600:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9774097 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977409e expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.613680:0:6681:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9774097 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977409e expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790613.613789:0:6681:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787790613.613794:0:6681:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff931a493ae800 10000000:01000000:1.0:1787790613.613797:0:6681:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff931a493ae800 10000000:01000000:1.0:1787790613.613803:0:6681:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787790613.613811:0:6681:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff931a493ae800 from 1 10000000:01000000:1.0:1787790613.613814:0:6681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787790613.613861:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa97740a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.613870:0:6681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa97740a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.613882:0:6681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa97740a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790613.613911:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253278848:0@lo:101: 00000100:00100000:1.0:1787790613.613993:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790613.614052:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b64a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787790613.614122:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253278848 00000100:00100000:2.0:1787790613.614130:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253278848 00000100:00100000:2.0:1787790613.614217:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787790613.614228:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:6681:x1874634253278848:12345-0@lo:101: 00010000:00010000:2.0:1787790613.614244:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790613.614261:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a542f1000/0x70647b5fa97740ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97740a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790613.614290:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a542f1000/0x70647b5fa97740ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97740a5 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790613.614303:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a542f1000/0x70647b5fa97740ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97740a5 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790613.614313:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f1000, rc 0) 00000100:00100000:2.0:1787790613.614359:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:6681:x1874634253278848:12345-0@lo:101: Request processed in 133us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790613.614366:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787790613.614449:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253278848:0@lo:101: 00010000:00010000:1.0:1787790613.614465:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa97740a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97740ac expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.614475:0:6681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa97740a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97740ac expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790613.614592:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253278976:0@lo:501: 00000100:00100000:1.0:1787790613.614631:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790613.614648:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b64a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787790613.614665:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253278976 00000100:00100000:1.0:1787790613.614668:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253278976 00000100:00100000:1.0:1787790613.614693:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787790613.614700:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:6681:x1874634253278976:12345-0@lo:501: 00000100:00100000:1.0:1787790613.615001:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:6681:x1874634253278976:12345-0@lo:501: Request processed in 300us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790613.615010:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787790613.615059:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253278976:0@lo:501: 00000100:00100000:1.0:1787790613.615088:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253279104:0@lo:503: 00000100:00100000:1.0:1787790613.615125:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790613.615144:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b64a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787790613.615157:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253279104 00000100:00100000:1.0:1787790613.615161:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253279104 00000100:00100000:1.0:1787790613.615181:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787790613.615187:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:6681:x1874634253279104:12345-0@lo:503: 00000100:00100000:1.0:1787790613.615335:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:6681:x1874634253279104:12345-0@lo:503: Request processed in 147us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790613.615342:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787790613.615718:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253279104:0@lo:503: 00000040:00080000:1.0:1787790613.616130:0:6681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787790613.616209:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253279232:0@lo:502: 00000100:00100000:1.0:1787790613.616273:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790613.616365:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b64a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787790613.616483:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253279232 00000100:00100000:2.0:1787790613.616489:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253279232 00000100:00100000:2.0:1787790613.616571:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787790613.616581:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:6681:x1874634253279232:12345-0@lo:502: 00000100:00100000:2.0:1787790613.616852:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:6681:x1874634253279232:12345-0@lo:502: Request processed in 272us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790613.616866:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787790613.617044:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253279232:0@lo:502: 00000040:00080000:1.0:1787790613.617449:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787790613.617538:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787790613.617595:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787790613.617675:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787790613.617716:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787790613.617799:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787790613.617828:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787790613.617853:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787790613.617891:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787790613.617919:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787790613.617949:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787790613.617982:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787790613.618007:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787790613.618030:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787790613.618063:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787790613.618088:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787790613.618111:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787790613.618143:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787790613.618167:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787790613.618191:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787790613.618224:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787790613.618253:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787790613.618273:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787790613.618313:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787790613.618337:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787790613.618355:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787790613.618392:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787790613.618431:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1787790613.618492:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253279360:0@lo:502: 00000100:00100000:1.0:1787790613.618575:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790613.618937:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b64a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787790613.619530:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253279360 00000100:00100000:2.0:1787790613.619540:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253279360 00000100:00100000:2.0:1787790613.619606:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787790613.619684:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:6681:x1874634253279360:12345-0@lo:502: 00000100:00100000:2.0:1787790613.620026:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:6681:x1874634253279360:12345-0@lo:502: Request processed in 409us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790613.620035:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787790613.620268:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253279360:0@lo:502: 00000040:00080000:1.0:1787790613.620787:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787790613.620807:0:6681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787790613.621855:0:6705:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787790613.621879:0:6705:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff931a44ec0000) 00000020:00000080:0.0:1787790613.621906:0:6705:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1787790613.622023:0:6705:0:(tgt_mount.c:153:server_get_mount()) get mount ffff931a493ae800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787790613.622028:0:6705:0:(tgt_mount.c:187:server_put_mount()) put mount ffff931a493ae800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787790613.622031:0:6705:0:(obd_mount.c:710:lustre_put_lsi()) put ffff931a493ae800 3 00010000:00080000:0.0:1787790613.622072:0:6705:0:(ldlm_lib.c:102:import_set_conn()) imp ffff931a7c0a9800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.125@tcp at head 00010000:00010000:0.0:1787790613.626438:0:6705:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1787790613.626670:0:6705:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787790613.626708:0:6705:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787790613.628823:0:6705:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x70647b5fa97740ba 00000100:00080000:0.0:1787790613.628844:0:6705:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787790613.628852:0:6705:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff931a7c0a9800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1787790613.628902:0:6705:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931a53ee9a40 x1874634253279488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787790613.628956:0:6705:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787790613.629023:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1874634253279488:0@lo:38: 00000100:00100000:3.0:1787790613.629124:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790613.629212:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253279488 00000100:00100000:3.0:1787790613.629220:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253279488 00000100:00100000:3.0:1787790613.629256:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787790613.629264:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3317:x1874634253279488:12345-0@lo:38: 00010000:00080000:3.0:1787790613.629292:0:5848:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:3.0:1787790613.629342:0:5848:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x70647b5fa97740c1 00000004:00100000:3.0:1787790613.629359:0:5848:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000040:00080000:0.0:1787790613.629373:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00080000:3.0:1787790613.629392:0:5848:0:(import.c:65:import_set_state_nolock()) ffff9319447e1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790613.629446:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874634253279488:12345-0@lo:38: Request processed in 182us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790613.629455:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787790613.629503:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff931a53ee9a40 x1874634253279488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787790623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790613.629514:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787790613.629521:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787790613.629529:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787790613.629534:0:3317:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787790613.629537:0:3317:0:(import.c:65:import_set_state_nolock()) ffff931a7c0a9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787790613.629545:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1874634253279488:0@lo:38: 00000100:00100000:1.0:1787790613.630746:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253279616:0@lo:400: 00000100:00100000:1.0:1787790613.630833:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1787790613.630933:0:6681:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787790613.630971:0:6681:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787790613.630993:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa97740a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97740ac expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790613.631007:0:6681:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa97740a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97740ac expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787790613.631064:0:6681:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787790613.631067:0:6681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787790613.631068:0:6681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790613.631069:0:6681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790613.631071:0:6681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790613.631072:0:6681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790613.631074:0:6681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787790613.631076:0:6681:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787790613.631077:0:6681:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787790613.631080:0:6681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790613.631081:0:6681:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787790613.631087:0:6681:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787790613.631090:0:6681:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787790613.631091:0:6681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787790613.631092:0:6681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790613.631093:0:6681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790613.631095:0:6681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790613.631101:0:6681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790613.631102:0:6681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787790613.631103:0:6681:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787790613.631104:0:6681:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787790613.631105:0:6681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790613.631106:0:6681:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787790613.631130:0:6681:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787790613.631144:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253279744:0@lo:253: 00000100:00100000:1.0:1787790613.631183:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790613.631206:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a43a0b000 going to sleep for 11 seconds 00000100:00100000:1.0:1787790613.631228:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253279744 00000100:00100000:1.0:1787790613.631233:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253279744 00000100:00100000:1.0:1787790613.631278:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787790613.631287:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:6681:x1874634253279744:12345-0@lo:253: 20000000:01000000:1.0:1787790613.631315:0:5840:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787790613.631333:0:5840:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787790613.633311:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253279616 00000100:00100000:3.0:1787790613.633328:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253279616 00000100:00100000:3.0:1787790613.633423:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787790613.633435:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253279616:12345-0@lo:400: 00000100:00100000:3.0:1787790613.633570:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253279616:12345-0@lo:400: Request processed in 137us (2737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790613.633579:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787790613.633811:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff931a45dbe940 x1874634253279616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790613.633832:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253279616:0@lo:400: 20000000:01000000:1.0:1787790613.720136:0:5840:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787790613.720161:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787790613.720516:0:5862:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787790613.720523:0:5862:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787790613.720555:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff931a542f0800/0x70647b5fa97740c8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790613.720580:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a40030e00/0x70647b5fa9774027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9774020 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790613.720590:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff931a542f0800/0x70647b5fa97740c8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790613.720646:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a40030e00/0x70647b5fa9774027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa9774020 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790613.720664:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a40030e00/0x70647b5fa9774027 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa9774020 expref: 13 pid: 5841 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790613.720681:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53cce940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1874634253279872:0@lo:104: 00000100:00100000:2.0:1787790613.720906:0:5862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790613.721016:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47964180 going to sleep for 11 seconds 00000100:00100000:0.0:1787790613.721168:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253279872 00000100:00100000:0.0:1787790613.721177:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253279872 00000100:00100000:0.0:1787790613.721244:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787790613.721255:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ccc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:5862:x1874634253279872:12345-0@lo:104: 00010000:00010000:0.0:1787790613.721274:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9774027 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.721485:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787790613.721493:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ccc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:5862:x1874634253279872:12345-0@lo:104: Request processed in 240us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790613.721501:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787790613.722188:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790613.722214:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9774027 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790613.722224:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41478800 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:2.0:1787790613.722229:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa9774027 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790613.722239:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa9774027 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790613.722247:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa9774027 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790613.722254:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787790613.722300:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774020 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774027 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790613.722308:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790613.722340:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774020 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774027 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790613.722349:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774020 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774027 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790613.722373:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790613.722375:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790613.722376:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790613.722391:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253280000:0@lo:103: 00000100:00100000:2.0:1787790613.722453:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790613.722637:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253280000 00000100:00100000:0.0:1787790613.722645:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253280000 00010000:00010000:0.0:1787790613.722673:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a40030e00/0x70647b5fa9774027 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9774020 expref: 14 pid: 5841 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790613.722699:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787790613.722707:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a493cf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:3319:x1874634253280000:12345-0@lo:103: 00010000:00010000:0.0:1787790613.722720:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790613.722826:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a40030e00/0x70647b5fa9774027 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9774020 expref: 14 pid: 5841 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.722885:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a40030e00/0x70647b5fa9774027 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa9774020 expref: 14 pid: 5841 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.722926:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff931a542f0800/0x70647b5fa97740c8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.722951:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a542f0800/0x70647b5fa97740c8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787790613.722972:0:5833:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002449103s 00010000:00010000:0.0:1787790613.722981:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a542f0800/0x70647b5fa97740c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.722989:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a542f0800/0x70647b5fa97740c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.722995:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff931a542f0800/0x70647b5fa97740c8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.723003:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff931a542f0800/0x70647b5fa97740c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.723009:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f0800 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:0.0:1787790613.723014:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff931a542f0800/0x70647b5fa97740c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.723021:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff931a542f0800/0x70647b5fa97740c8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.723032:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff931a542f0800/0x70647b5fa97740c8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790613.723054:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790613.723099:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a493cf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:3319:x1874634253280000:12345-0@lo:103: Request processed in 392us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790613.723107:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787790613.723189:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253280000:0@lo:103: 00010000:00010000:3.0:1787790613.725718:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a40030e00/0x70647b5fa9774027 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa9774020 expref: 13 pid: 5841 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790613.725815:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53cce940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1874634253279872:0@lo:104: 00010000:00010000:3.0:1787790613.725871:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff931a542f0800/0x70647b5fa97740c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790613.725893:0:5862:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff931a542f0800/0x70647b5fa97740c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790613.725900:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff931a542f0800/0x70647b5fa97740c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790613.725916:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a542f0800/0x70647b5fa97740c8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790613.738245:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:6681:x1874634253279744:12345-0@lo:253: Request processed in 106940us (107043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790613.738265:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787790613.738518:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6681:1874634253279744:0@lo:253: 10000000:01000000:1.0:1787790613.738538:0:6681:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787790613.738542:0:6681:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787790613.738544:0:6681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787790613.738545:0:6681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790613.738547:0:6681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790613.738548:0:6681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790613.738549:0:6681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790613.738551:0:6681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787790613.738553:0:6681:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787790613.738554:0:6681:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787790613.738556:0:6681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790613.738557:0:6681:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787790613.738574:0:6681:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787790613.744908:0:6681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787790613.745279:0:6681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787790613.745907:0:6681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787790613.746256:0:6681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787790613.746929:0:6681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787790613.747420:0:6681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787790613.750608:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787790614.009018:0:6681:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787790614.009029:0:6681:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787790614.009068:0:6681:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787790614.009154:0:6681:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.125@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787790614.009170:0:6681:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787790614.009209:0:6681:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787790614.283401:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790615.304121:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787790615.490204:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787790615.490213:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff931a4977d000 from 21 10000000:01000000:2.0:1787790615.490230:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787790615.490274:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f1600/0x70647b5fa97740cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790615.490286:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a542f1600/0x70647b5fa97740cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790615.490296:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a542f1600/0x70647b5fa97740cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790615.490320:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253280128:0@lo:101: 00000100:00100000:2.0:1787790615.490389:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790615.490454:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931946508f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787790615.490799:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253280128 00000100:00100000:1.0:1787790615.490806:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253280128 00000100:00100000:1.0:1787790615.490862:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787790615.490872:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:5843:x1874634253280128:12345-0@lo:101: 00010000:00010000:1.0:1787790615.490885:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790615.490898:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a41479800/0x70647b5fa97740d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97740cf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790615.490923:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a41479800/0x70647b5fa97740d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97740cf expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790615.490934:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a41479800/0x70647b5fa97740d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97740cf expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790615.490944:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41479800, rc 0) 00000100:00100000:1.0:1787790615.490992:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:5843:x1874634253280128:12345-0@lo:101: Request processed in 122us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790615.491000:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787790615.491027:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253280128:0@lo:101: 00010000:00010000:2.0:1787790615.491041:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a542f1600/0x70647b5fa97740cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97740d6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790615.491051:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a542f1600/0x70647b5fa97740cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97740d6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790615.491116:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253280256:0@lo:501: 00000100:00100000:2.0:1787790615.491144:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790615.491161:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931946508f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787790615.491369:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253280256 00000100:00100000:1.0:1787790615.491373:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253280256 00000100:00100000:1.0:1787790615.491402:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787790615.491409:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:5843:x1874634253280256:12345-0@lo:501: 00000100:00100000:1.0:1787790615.491807:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:5843:x1874634253280256:12345-0@lo:501: Request processed in 397us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790615.491814:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787790615.491954:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253280256:0@lo:501: 00000100:00100000:2.0:1787790615.491986:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253280384:0@lo:503: 00000100:00100000:2.0:1787790615.492024:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790615.492054:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931946508f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787790615.492128:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253280384 00000100:00100000:0.0:1787790615.492133:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253280384 00000100:00100000:0.0:1787790615.492313:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787790615.492322:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:5843:x1874634253280384:12345-0@lo:503: 00000100:00100000:1.0:1787790615.494087:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:5843:x1874634253280384:12345-0@lo:503: Request processed in 1759us (2055us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790615.494099:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787790615.494322:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253280384:0@lo:503: 00000100:00100000:1.0:1787790615.502797:0:6786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6786:1874634253280512:0@lo:502: 00000100:00100000:1.0:1787790615.502884:0:6786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790615.502923:0:6786:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a43a0bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790615.504782:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253280512 00000100:00100000:0.0:1787790615.504797:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253280512 00000100:00100000:0.0:1787790615.504856:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787790615.504865:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:6786:x1874634253280512:12345-0@lo:502: 00000100:00100000:0.0:1787790615.505237:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:6786:x1874634253280512:12345-0@lo:502: Request processed in 372us (2352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790615.505246:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787790615.505310:0:6786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6786:1874634253280512:0@lo:502: 00000100:00100000:2.0:1787790615.505380:0:6786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6786:1874634253280640:0@lo:502: 00000100:00100000:2.0:1787790615.505422:0:6786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790615.505456:0:6786:0:(client.c:2715:ptlrpc_set_wait()) set ffff931946508540 going to sleep for 11 seconds 00000100:00100000:3.0:1787790615.506374:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253280640 00000100:00100000:3.0:1787790615.506381:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253280640 00000100:00100000:3.0:1787790615.506424:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787790615.506432:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:6786:x1874634253280640:12345-0@lo:502: 00000100:00100000:3.0:1787790615.506633:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:6786:x1874634253280640:12345-0@lo:502: Request processed in 201us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790615.506650:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787790615.506864:0:6786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6786:1874634253280640:0@lo:502: 00000040:00080000:0.0:1787790615.506895:0:6786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787790615.507020:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787790615.507038:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787790615.507048:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f1600/0x70647b5fa97740cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97740d6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790615.507058:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a542f1600/0x70647b5fa97740cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97740d6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790615.507068:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787790615.507070:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff931a4977d000 from 4 10000000:01000000:2.0:1787790615.507073:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787790615.507103:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97740dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790615.507111:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97740dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790615.507121:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97740dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790615.507137:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53cce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253280768:0@lo:101: 00000100:00100000:2.0:1787790615.507171:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790615.507204:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9319465086c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790615.507552:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253280768 00000100:00100000:0.0:1787790615.507557:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253280768 00000100:00100000:0.0:1787790615.507598:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787790615.507606:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:5843:x1874634253280768:12345-0@lo:101: 00010000:00010000:0.0:1787790615.507616:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790615.507629:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a40030400/0x70647b5fa97740e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97740dd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790615.507652:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a40030400/0x70647b5fa97740e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97740dd expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790615.507663:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a40030400/0x70647b5fa97740e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97740dd expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790615.507672:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a40030400, rc 0) 00000100:00100000:0.0:1787790615.507716:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:5843:x1874634253280768:12345-0@lo:101: Request processed in 111us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790615.507754:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787790615.507779:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53cce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253280768:0@lo:101: 00010000:00010000:2.0:1787790615.507792:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97740dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97740e4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790615.507812:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97740dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97740e4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790615.507857:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53cce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253280896:0@lo:256: 00000100:00100000:2.0:1787790615.507887:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790615.507919:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9319465086c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790615.508041:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253280896 00000100:00100000:0.0:1787790615.508045:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253280896 00000100:00100000:0.0:1787790615.508074:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787790615.508082:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:5843:x1874634253280896:12345-0@lo:256: 20000000:01000000:0.0:1787790615.508096:0:5841:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787790615.508112:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787790615.508115:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787790615.508191:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:5843:x1874634253280896:12345-0@lo:256: Request processed in 111us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790615.508198:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787790615.508270:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53cce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253280896:0@lo:256: 10000000:01000000:2.0:1787790615.508312:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787790615.508319:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97740dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97740e4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790615.508326:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97740dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97740e4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790615.508333:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787790615.508335:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787790615.508338:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787790615.508355:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa97740eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790615.508363:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa97740eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790615.508369:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa97740eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790615.508381:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53cce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253281024:0@lo:101: 00000100:00100000:2.0:1787790615.508414:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790615.508435:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9319465086c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790615.508482:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253281024 00000100:00100000:0.0:1787790615.508486:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253281024 00000100:00100000:0.0:1787790615.508517:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787790615.508530:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:5843:x1874634253281024:12345-0@lo:101: 00010000:00010000:0.0:1787790615.508538:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790615.508546:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a40030000/0x70647b5fa97740f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97740eb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790615.508560:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a40030000/0x70647b5fa97740f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97740eb expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790615.508568:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a40030000/0x70647b5fa97740f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97740eb expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790615.508575:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a40030000, rc 0) 00000100:00100000:0.0:1787790615.508602:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:5843:x1874634253281024:12345-0@lo:101: Request processed in 74us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790615.508608:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787790615.508696:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53cce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253281024:0@lo:101: 00010000:00010000:2.0:1787790615.508706:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa97740eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97740f2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790615.508713:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa97740eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97740f2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790615.508782:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53cce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253281152:0@lo:501: 00000100:00100000:2.0:1787790615.508806:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790615.508820:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9319465086c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790615.508833:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253281152 00000100:00100000:2.0:1787790615.508836:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253281152 00000100:00100000:2.0:1787790615.508853:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787790615.508859:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:5843:x1874634253281152:12345-0@lo:501: 00000100:00100000:2.0:1787790615.509172:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:5843:x1874634253281152:12345-0@lo:501: Request processed in 312us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790615.509179:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787790615.509248:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53cce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253281152:0@lo:501: 00000100:00100000:3.0:1787790615.509278:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f07840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253281280:0@lo:503: 00000100:00100000:3.0:1787790615.509315:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790615.509346:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47a346c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790615.509397:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253281280 00000100:00100000:2.0:1787790615.509401:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253281280 00000100:00100000:2.0:1787790615.509428:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787790615.509434:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:5843:x1874634253281280:12345-0@lo:503: 00000100:00100000:2.0:1787790615.509747:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:5843:x1874634253281280:12345-0@lo:503: Request processed in 287us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790615.509754:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787790615.509908:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f07840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253281280:0@lo:503: 00000100:00100000:2.0:1787790615.514808:0:6787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53cced00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6787:1874634253281408:0@lo:502: 00000100:00100000:2.0:1787790615.514886:0:6787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790615.514927:0:6787:0:(client.c:2715:ptlrpc_set_wait()) set ffff931946508300 going to sleep for 11 seconds 00000100:00100000:0.0:1787790615.514927:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253281408 00000100:00100000:0.0:1787790615.514998:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253281408 00000100:00100000:0.0:1787790615.515041:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787790615.515051:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:6787:x1874634253281408:12345-0@lo:502: 00000100:00100000:0.0:1787790615.515350:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:6787:x1874634253281408:12345-0@lo:502: Request processed in 299us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790615.515357:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787790615.515713:0:6787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53cced00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6787:1874634253281408:0@lo:502: 00000020:01000000:2.0:1787790615.515769:0:6787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787790615.515776:0:6787:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787790615.515783:0:6787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790615.515785:0:6787:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787790615.515789:0:6787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787790615.515793:0:6787:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.125@tcp to nid 0x20000c0a8c97d (192.168.201.125@tcp) 00000020:01000000:2.0:1787790615.515814:0:6787:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787790615.515817:0:6787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787790615.515830:0:6787:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff931a42f88000) 00000020:00000080:2.0:1787790615.515850:0:6787:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787790615.515854:0:6787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787790615.515937:0:6787:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787790615.515943:0:6787:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787790615.515950:0:6787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70647b5fa9774100 00010000:00080000:2.0:1787790615.515978:0:6787:0:(ldlm_lib.c:102:import_set_conn()) imp ffff931a7d975000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.125@tcp at head 00010000:00010000:2.0:1787790615.516209:0:6787:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787790615.576869:0:6787:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787790615.576895:0:6787:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787790615.577468:0:6787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787790615.577651:0:6787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787790615.577703:0:6787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787790615.577802:0:6787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787790615.578788:0:6790:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787790615.578794:0:6790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787790615.579449:0:6787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787790615.579584:0:6787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787790615.580076:0:6787:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787790615.580108:0:6787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x70647b5fa9774107 00000100:00080000:2.0:1787790615.580119:0:6787:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787790615.580126:0:6787:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff931a7d975000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:2.0:1787790615.580161:0:6787:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931a53cced00 x1874634253281536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787790615.580226:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53cced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1874634253281536:0@lo:8: 00000100:00100000:0.0:1787790615.580313:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790615.580410:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253281536 00000100:00100000:1.0:1787790615.580417:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253281536 00000100:00100000:1.0:1787790615.580450:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787790615.580468:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ee9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3317:x1874634253281536:12345-0@lo:8: 00010000:00080000:1.0:1787790615.580495:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 150 last 0 00000020:00000080:1.0:1787790615.580522:0:6683:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x70647b5fa977410e 00002000:00100000:1.0:1787790615.580558:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff931944ea8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113932 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787790615.580563:0:6683:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1787790615.580566:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787790615.580680:0:6683:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787790615.580852:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787790615.580877:0:6683:0:(import.c:65:import_set_state_nolock()) ffff931944eaa000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787790615.580962:0:6787:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787790615.581037:0:6787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790615.581043:0:6787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790615.581045:0:6787:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787790615.581048:0:6787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790615.581053:0:6787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790615.581055:0:6787:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787790615.581058:0:6787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787790615.581060:0:6787:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787790615.581087:0:6787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53cce1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6787:1874634253281664:0@lo:502: 00000100:00100000:2.0:1787790615.581137:0:6787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790615.581160:0:6787:0:(client.c:2715:ptlrpc_set_wait()) set ffff931946508840 going to sleep for 11 seconds 00000100:00100000:2.0:1787790615.581225:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253281664 00000100:00100000:2.0:1787790615.581229:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253281664 00000100:00100000:2.0:1787790615.581256:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787790615.581263:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:6787:x1874634253281664:12345-0@lo:502: 00000100:00100000:2.0:1787790615.581472:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:6787:x1874634253281664:12345-0@lo:502: Request processed in 209us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790615.581479:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787790615.581533:0:6787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53cce1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:6787:1874634253281664:0@lo:502: 00000020:01000000:2.0:1787790615.581557:0:6787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790615.581561:0:6787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790615.581563:0:6787:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787790615.581566:0:6787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1787790615.582075:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253281792:0@lo:400: 00000100:00100000:0.0:1787790615.582114:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790615.582144:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790615.582150:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253281920:0@lo:400: 00000100:00100000:0.0:1787790615.582192:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787790615.582221:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787790615.582240:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787790615.582249:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa97740eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97740f2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790615.582260:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa97740eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97740f2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790615.582269:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787790615.582272:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff931a44ec4d28 from 1 10000000:01000000:0.0:1787790615.582275:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787790615.582313:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40030a00/0x70647b5fa9774115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790615.582321:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a40030a00/0x70647b5fa9774115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790615.582331:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a40030a00/0x70647b5fa9774115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790615.582345:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53eeb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253282048:0@lo:101: 00000100:00100000:0.0:1787790615.582372:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790615.582388:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a645b4600 going to sleep for 11 seconds 00000100:00100000:0.0:1787790615.582410:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253281792 00000100:00100000:0.0:1787790615.582414:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253281792 00000100:00100000:0.0:1787790615.582446:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253281920 00000100:00100000:0.0:1787790615.582449:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253281920 00000100:00100000:0.0:1787790615.582595:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787790615.582603:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ee9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253281792:12345-0@lo:400: 00000100:00100000:0.0:1787790615.582655:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ee9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253281792:12345-0@lo:400: Request processed in 53us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790615.582663:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787790615.582678:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787790615.582684:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ee8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253281920:12345-0@lo:400: 00000100:00100000:0.0:1787790615.582711:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ee8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253281920:12345-0@lo:400: Request processed in 28us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790615.582717:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787790615.582762:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253282048 00000100:00100000:0.0:1787790615.582766:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253282048 00000100:00100000:0.0:1787790615.582787:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787790615.582793:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:5843:x1874634253282048:12345-0@lo:101: 00010000:00010000:0.0:1787790615.582800:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790615.582813:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a40030200/0x70647b5fa977411c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9774115 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790615.582834:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a40030200/0x70647b5fa977411c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9774115 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790615.582844:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a40030200/0x70647b5fa977411c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9774115 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790615.582851:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a40030200, rc 0) 00000100:00100000:0.0:1787790615.582879:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:5843:x1874634253282048:12345-0@lo:101: Request processed in 86us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790615.582885:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1787790615.582926:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a53ccf0c0 x1874634253281920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790615.582948:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253281920:0@lo:400: 00010000:00080000:0.0:1787790615.582962:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a53ccc000 x1874634253281792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790615.582969:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253281792:0@lo:400: 00000100:00100000:0.0:1787790615.582995:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53eeb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253282048:0@lo:101: 00010000:00010000:0.0:1787790615.583008:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a40030a00/0x70647b5fa9774115 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977411c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790615.583016:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a40030a00/0x70647b5fa9774115 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa977411c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790615.583061:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53eeb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253282176:0@lo:501: 00000100:00100000:0.0:1787790615.583086:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790615.583098:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a645b4600 going to sleep for 11 seconds 00000100:00100000:0.0:1787790615.583110:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253282176 00000100:00100000:0.0:1787790615.583113:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253282176 00000100:00100000:0.0:1787790615.583133:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787790615.583139:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:5843:x1874634253282176:12345-0@lo:501: 00000100:00100000:0.0:1787790615.583593:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:5843:x1874634253282176:12345-0@lo:501: Request processed in 453us (505us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787790615.583601:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787790615.583636:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53eeb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253282176:0@lo:501: 10000000:01000000:0.0:1787790615.583659:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787790615.583665:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40030a00/0x70647b5fa9774115 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977411c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790615.583679:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a40030a00/0x70647b5fa9774115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977411c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790615.583917:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ee9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1874634253281536:12345-0@lo:8: Request processed in 3455us (3600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790615.583934:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787790615.583967:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787790615.584049:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a53cced00 x1874634253281536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787790625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790615.584058:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787790615.584065:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787790615.584072:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787790615.584077:0:3317:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787790615.584080:0:3317:0:(import.c:65:import_set_state_nolock()) ffff931a7d975000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787790615.584417:0:3317:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787790615.584426:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53cced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1874634253281536:0@lo:8: 00000004:00080000:2.0:1787790615.585190:0:6790:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787790615.585445:0:6790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 150465719841ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787790615.633607:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253282304:0@lo:13: 00000100:00100000:1.0:1787790615.633688:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787790615.633784:0:6791:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787790615.633809:0:6791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6791:1874634253282432:0@lo:7: 00000100:00100000:1.0:1787790615.633837:0:6791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790615.633863:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253282432 00000100:00100000:1.0:1787790615.633869:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253282432 00000100:00100000:1.0:1787790615.633912:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787790615.633920:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6791:x1874634253282432:12345-0@lo:7: 00000100:00100000:3.0:1787790615.637630:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253282304 00000100:00100000:3.0:1787790615.637642:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253282304 00000100:00100000:3.0:1787790615.637689:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787790615.637700:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1874634253282304:12345-0@lo:13: 00002000:00000024:3.0:1787790615.637768:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787790615.637858:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1874634253282304:12345-0@lo:13: Request processed in 160us (4169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790615.637865:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787790615.645336:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787790615.645397:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a45dbfc00 x1874634253282304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790631 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790615.645425:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253282304:0@lo:13: 00002000:00080000:1.0:1787790615.648019:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1787790615.648026:0:6685:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787790615.648098:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6791:x1874634253282432:12345-0@lo:7: Request processed in 14175us (14257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790615.648108:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787790615.648166:0:6791:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a43a0bd80 going to sleep for 11 seconds 00010000:00080000:1.0:1787790615.651350:0:6791:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a45dbf480 x1874634253282432/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787790631 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790615.651384:0:6791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6791:1874634253282432:0@lo:7: 00000004:00080000:1.0:1787790615.651404:0:6791:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787790615.651459:0:6791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6791:1874634253282560:0@lo:5: 00000100:00100000:1.0:1787790615.651541:0:6791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790615.651585:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253282560 00000100:00100000:1.0:1787790615.651591:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253282560 00000100:00100000:1.0:1787790615.651632:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787790615.651640:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6791:x1874634253282560:12345-0@lo:5: 00002000:00080000:1.0:1787790615.651667:0:6684:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787790615.651671:0:6684:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787790615.652000:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6791:x1874634253282560:12345-0@lo:5: Request processed in 359us (457us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787790615.652008:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787790615.652042:0:6791:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a43a0bd80 going to sleep for 11 seconds 00010000:00080000:1.0:1787790615.652062:0:6791:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a45dbf480 x1874634253282560/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787790631 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790615.652074:0:6791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6791:1874634253282560:0@lo:5: 00000004:00080000:1.0:1787790615.652083:0:6791:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787790615.652107:0:6791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6791:1874634253282688:0@lo:700: 00000100:00100000:1.0:1787790615.652132:0:6791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790615.652164:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253282688 00000100:00100000:1.0:1787790615.652167:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253282688 00000100:00100000:1.0:1787790615.656414:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787790615.656432:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6791:x1874634253282688:12345-0@lo:700: 00000100:00100000:1.0:1787790615.656491:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6692:1874634253282816:0@lo:700: 00000100:00100000:1.0:1787790615.656555:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790615.656582:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a43a0b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787790615.656607:0:6791:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a43a0bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790615.659870:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253282816 00000100:00100000:0.0:1787790615.659884:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253282816 00000100:00100000:0.0:1787790615.659946:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790615.659957:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6692:x1874634253282816:12345-0@lo:700: 00000004:00080000:1.0:1787790615.691973:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:0.0:1787790615.727355:0:5853:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787790615.737133:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6692:x1874634253282816:12345-0@lo:700: Request processed in 77168us (80566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790615.737147:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787790615.737436:0:6692:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a45dbe940 x1874634253282816/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787790631 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790615.737451:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6692:1874634253282816:0@lo:700: 40000000:02000000:1.0:1787790615.737465:0:6692:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:1.0:1787790615.853253:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6791:x1874634253282688:12345-0@lo:700: Request processed in 196817us (201109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790615.853269:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:1.0:1787790615.853327:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1787790615.853340:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1787790615.853379:0:6791:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a45dbe580 x1874634253282688/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787790631 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790615.853396:0:6791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6791:1874634253282688:0@lo:700: 00000004:02000040:1.0:1787790615.951706:0:6791:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1787790615.963829:0:6791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53cce1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6791:1874634253282944:0@lo:5: 00000100:00100000:2.0:1787790615.963904:0:6791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790615.963978:0:6791:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a455a4780 going to sleep for 11 seconds 00000100:00100000:0.0:1787790615.964075:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253282944 00000100:00100000:0.0:1787790615.964083:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253282944 00000100:00100000:0.0:1787790615.964133:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787790615.964142:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ccf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6791:x1874634253282944:12345-0@lo:5: 00002000:00080000:0.0:1787790615.972384:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787790615.972415:0:6685:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1787790615.978649:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ccf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6791:x1874634253282944:12345-0@lo:5: Request processed in 14501us (14737us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787790615.978664:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787790615.980007:0:6791:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a53cce1c0 x1874634253282944/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787790631 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790615.980024:0:6791:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787790615.980041:0:6791:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff931a53cce1c0 x1874634253282944/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787790631 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790615.980053:0:6791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53cce1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6791:1874634253282944:0@lo:5: 00000004:00080000:1.0:1787790615.980067:0:6791:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787790616.320643:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790617.343879:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790618.368279:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790619.391893:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787790619.680588:0:7051:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787790620.421485:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790620.738885:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253283072:0@lo:400: 00000100:00100000:1.0:1787790620.738958:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790620.739022:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787790620.739027:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253283456:0@lo:400: 00000100:00100000:1.0:1787790620.739049:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790620.739070:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1874634253283328:0@lo:400: 00000100:00100000:1.0:1787790620.739099:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790620.739113:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787790620.739117:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253283200:0@lo:400: 00000100:00100000:1.0:1787790620.739131:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790620.739150:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253283456 00000100:00100000:1.0:1787790620.739156:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253283456 00000100:00100000:1.0:1787790620.739207:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787790620.739216:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3319:x1874634253283456:12345-0@lo:400: 00000100:00100000:1.0:1787790620.739267:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3319:x1874634253283456:12345-0@lo:400: Request processed in 52us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790620.739274:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787790620.739291:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787790620.739312:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a45dbf480 x1874634253283456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790620.739322:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253283456:0@lo:400: 00000100:00100000:0.0:1787790620.741279:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253283072 00000100:00100000:0.0:1787790620.741291:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253283072 00000100:00100000:0.0:1787790620.741350:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787790620.741359:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:3319:x1874634253283072:12345-0@lo:400: 00000100:00100000:0.0:1787790620.741437:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:3319:x1874634253283072:12345-0@lo:400: Request processed in 79us (2478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790620.741443:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787790620.741475:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253283328 00000100:00100000:0.0:1787790620.741479:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253283328 00000100:00100000:0.0:1787790620.741514:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253283200 00000100:00100000:0.0:1787790620.741517:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253283200 00000100:00100000:0.0:1787790620.741531:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787790620.741537:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874634253283328:12345-0@lo:400: 00000100:00100000:0.0:1787790620.741575:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874634253283328:12345-0@lo:400: Request processed in 38us (2474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790620.741581:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787790620.741592:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787790620.741598:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253283200:12345-0@lo:400: 00000100:00100000:0.0:1787790620.741625:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253283200:12345-0@lo:400: Request processed in 28us (2492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790620.741631:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787790620.741686:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253283072:0@lo:400: 00000100:00080000:0.0:1787790620.741710:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787790620.741771:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a45dbf840 x1874634253283200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790620.741783:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253283200:0@lo:400: 00010000:00080000:0.0:1787790620.741795:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a45dbde00 x1874634253283328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790620.741803:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1874634253283328:0@lo:400: 00000100:00100000:1.0:1787790620.743891:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253283584:0@lo:13: 00000100:00100000:1.0:1787790620.743956:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790620.744048:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253283584 00000100:00100000:3.0:1787790620.744055:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253283584 00000100:00100000:3.0:1787790620.744130:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790620.744138:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1874634253283584:12345-0@lo:13: 00002000:00000024:3.0:1787790620.744186:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790620.744244:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1874634253283584:12345-0@lo:13: Request processed in 106us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790620.744251:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787790620.744288:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a53f07840 x1874634253283584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790636 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790620.744306:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253283584:0@lo:13: 00000001:00080000:1.0:1787790621.328334:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787790621.440955:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790622.467955:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790623.488503:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790624.518883:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790625.537049:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790625.856130:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253283712:0@lo:400: 00000100:00100000:1.0:1787790625.856155:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253284096:0@lo:400: 00000100:00100000:2.0:1787790625.856220:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253283840:0@lo:400: 00000100:00100000:3.0:1787790625.861361:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253283968:0@lo:400: 00000100:00100000:1.0:1787790625.864649:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790625.866594:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790625.866646:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787790625.866659:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253284224:0@lo:13: 00000100:00100000:2.0:1787790625.866694:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790625.866757:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253283840 00000100:00100000:2.0:1787790625.866764:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253283840 00000100:00100000:2.0:1787790625.866810:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787790625.866819:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ccde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253283840:12345-0@lo:400: 00000100:00100000:2.0:1787790625.866873:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ccde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253283840:12345-0@lo:400: Request processed in 55us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790625.866880:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787790625.866908:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253284224 00000100:00100000:2.0:1787790625.866912:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253284224 00000100:00100000:2.0:1787790625.866958:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787790625.866965:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ccda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253284224:12345-0@lo:13: 00002000:00000024:2.0:1787790625.866992:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787790625.867027:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ccda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253284224:12345-0@lo:13: Request processed in 63us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790625.867034:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787790625.867429:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787790625.867463:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a53f07c00 x1874634253284224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790641 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790625.867474:0:3321:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787790625.867495:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253284224:0@lo:13: 00010000:00080000:2.0:1787790625.867508:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a456db840 x1874634253283840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790625.867517:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253283840:0@lo:400: 00000100:00100000:0.0:1787790625.868254:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790625.868299:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253284096 00000100:00100000:0.0:1787790625.868305:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253284096 00000100:00100000:2.0:1787790625.868514:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253283712 00000100:00100000:2.0:1787790625.868518:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253283712 00000100:00100000:2.0:1787790625.868565:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787790625.868573:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:3320:x1874634253283712:12345-0@lo:400: 00000100:00100000:2.0:1787790625.868626:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:3320:x1874634253283712:12345-0@lo:400: Request processed in 54us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790625.868633:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787790625.868777:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787790625.868786:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456da580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253284096:12345-0@lo:400: 00000100:00100000:0.0:1787790625.868823:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456da580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253284096:12345-0@lo:400: Request processed in 39us (4182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790625.868829:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787790625.868869:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253283712:0@lo:400: 00010000:00080000:0.0:1787790625.869916:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a456da1c0 x1874634253284096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790625.869931:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253284096:0@lo:400: 00000100:00100000:3.0:1787790625.871227:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790625.871471:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253283968 00000100:00100000:0.0:1787790625.871479:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253283968 00000100:00100000:0.0:1787790625.871562:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787790625.871572:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253283968:12345-0@lo:400: 00000100:00100000:0.0:1787790625.871636:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253283968:12345-0@lo:400: Request processed in 66us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790625.871650:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787790625.871743:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787790625.872035:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a456dad00 x1874634253283968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790625.872047:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253283968:0@lo:400: 00010000:00010000:0.0:1787790626.560520:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790627.585040:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790628.607857:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790629.634258:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787790629.663117:0:7614:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787790629.663121:0:7614:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787790629.663270:0:7614:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9319447e6800 00000020:01000004:3.0:1787790629.663296:0:7614:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787790629.663309:0:7614:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787790629.663330:0:7614:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff931a42f2cd28) 00000020:00000080:3.0:1787790629.663346:0:7614:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787790629.676955:0:7614:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787790629.677265:0:7614:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787790629.697690:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787790629.708622:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787790629.708660:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787790629.708752:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787790629.708785:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787790629.709090:0:7614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787790629.709102:0:7614:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787790629.709115:0:7614:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x70647b5fa977412a 00000020:01000004:2.0:1787790629.709122:0:7614:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787790629.709139:0:7614:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.125@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787790629.709141:0:7614:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787790629.709145:0:7614:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787790629.709162:0:7614:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787790629.709166:0:7614:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.125@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787790629.725175:0:7614:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787790629.725206:0:7614:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.125@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787790629.725209:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787790629.725210:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787790629.725211:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787790629.725212:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787790629.725213:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787790629.725214:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787790629.725214:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787790629.725216:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787790629.725216:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787790629.725217:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787790629.725218:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787790629.725221:0:7614:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787790629.725222:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787790629.725223:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787790629.725224:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787790629.725224:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787790629.725225:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787790629.725225:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787790629.725226:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787790629.725227:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787790629.725227:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787790629.725228:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787790629.725228:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787790629.725253:0:7614:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787790629.725267:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f07840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253284352:0@lo:253: 00000100:00100000:3.0:1787790629.725325:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790629.725378:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253284352 00000100:00100000:3.0:1787790629.725384:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47964480 going to sleep for 11 seconds 00000100:00100000:0.0:1787790629.725386:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253284352 00000100:00100000:0.0:1787790629.725446:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787790629.725456:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:7614:x1874634253284352:12345-0@lo:253: 20000000:01000000:0.0:1787790629.725515:0:5841:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787790629.725520:0:5841:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787790629.725525:0:5841:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787790629.725528:0:5841:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787790629.727641:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787790629.727932:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787790629.728034:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787790629.728128:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787790629.728136:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787790629.728157:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787790629.728199:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1787790629.728856:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1787790629.728878:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.125@tcp 20000000:01000000:0.0:1787790629.728880:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.125@tcp (null) (null) (null) 00000040:00080000:0.0:1787790629.728919:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1787790629.728927:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787790629.728976:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1787790629.728985:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.125@tcp (null) (null) 00000040:00080000:0.0:1787790629.729018:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1787790629.729027:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787790629.729059:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1787790629.729116:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787790629.730045:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787790629.730067:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.125@tcp 20000000:01000000:1.0:1787790629.730069:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.125@tcp (null) (null) (null) 00000040:00080000:1.0:1787790629.730103:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787790629.730110:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787790629.730140:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787790629.730147:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.125@tcp (null) (null) 00000040:00080000:1.0:1787790629.730176:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787790629.730184:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787790629.730230:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787790629.730267:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787790629.730282:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1787790629.730285:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1787790629.730291:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787790629.730293:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787790629.730296:0:5841:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787790629.730307:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787790629.730309:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787790629.730340:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787790629.730343:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787790629.731035:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787790629.731100:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787790629.731132:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1787790629.731403:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1787790629.731446:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1787790629.731530:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1787790629.731548:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787790629.731550:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787790629.734887:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787790629.735306:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787790629.735333:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787790629.735391:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787790629.735401:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787790629.735403:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787790629.735846:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1787790629.735877:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1787790629.735906:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787790629.736137:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787790629.736158:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787790629.736189:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787790629.736196:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787790629.736198:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787790629.736533:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1787790629.736579:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1787790629.736611:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787790629.736823:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1787790629.736845:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1787790629.736862:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:1.0:1787790629.736872:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787790629.736887:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff931a41479200/0x70647b5fa9774131 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.736900:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a542f1e00/0x70647b5fa9774082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa977407b expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.736905:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a542f1000/0x70647b5fa97740ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97740a5 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.736910:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a41479800/0x70647b5fa97740d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97740cf expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.736913:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a40030000/0x70647b5fa97740f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97740eb expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.736917:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a40030200/0x70647b5fa977411c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9774115 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.736922:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff931a41479200/0x70647b5fa9774131 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.736968:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a40030200/0x70647b5fa977411c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa9774115 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.736982:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a40030200/0x70647b5fa977411c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa9774115 expref: 16 pid: 5841 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790629.736995:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456d8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874634253284480:0@lo:104: 00000100:00100000:1.0:1787790629.737057:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790629.737100:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a40030000/0x70647b5fa97740f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa97740eb expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.737106:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a40030000/0x70647b5fa97740f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa97740eb expref: 16 pid: 5840 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790629.737111:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456dbc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874634253284608:0@lo:104: 00010000:00010000:1.0:1787790629.737128:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a41479800/0x70647b5fa97740d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa97740cf expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.737132:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a41479800/0x70647b5fa97740d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa97740cf expref: 16 pid: 5841 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790629.737137:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456d8b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874634253284736:0@lo:104: 00010000:00010000:1.0:1787790629.737148:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a542f1000/0x70647b5fa97740ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa97740a5 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.737152:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a542f1000/0x70647b5fa97740ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa97740a5 expref: 16 pid: 5841 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790629.737157:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456d8f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874634253284864:0@lo:104: 00010000:00010000:1.0:1787790629.737167:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a542f1e00/0x70647b5fa9774082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa977407b expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.737172:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a542f1e00/0x70647b5fa9774082 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa977407b expref: 16 pid: 5840 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790629.737176:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456d92c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874634253284992:0@lo:104: 00000100:00100000:1.0:1787790629.737193:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d815480 going to sleep for 11 seconds 00000100:00100000:2.0:1787790629.737284:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787790629.737298:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790629.737317:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790629.737323:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790629.737328:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790629.737334:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253284480 00000100:00100000:2.0:1787790629.737338:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253284480 00000100:00100000:2.0:1787790629.737361:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253284608 00000100:00100000:2.0:1787790629.737362:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253284608 00000100:00100000:2.0:1787790629.737367:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253284736 00000100:00100000:2.0:1787790629.737368:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253284736 00000100:00100000:2.0:1787790629.737372:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253284864 00000100:00100000:2.0:1787790629.737373:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253284864 00000100:00100000:2.0:1787790629.737378:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253284992 00000100:00100000:2.0:1787790629.737379:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253284992 00000100:00100000:2.0:1787790629.737386:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787790629.737391:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a49d19c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+7:5841:x1874634253284480:12345-0@lo:104: 00010000:00010000:2.0:1787790629.737400:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a40030a00/0x70647b5fa9774115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa977411c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737441:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787790629.737448:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a49d19c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+7:5841:x1874634253284480:12345-0@lo:104: Request processed in 56us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790629.737462:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787790629.737513:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787790629.737518:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53cce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+6:5841:x1874634253284608:12345-0@lo:104: 00010000:00010000:2.0:1787790629.737523:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa97740eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97740f2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737545:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787790629.737548:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53cce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+6:5841:x1874634253284608:12345-0@lo:104: Request processed in 31us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790629.737551:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787790629.737559:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787790629.737562:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53cce940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+5:5841:x1874634253284736:12345-0@lo:104: 00010000:00010000:2.0:1787790629.737566:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a542f1600/0x70647b5fa97740cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97740d6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737579:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787790629.737582:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53cce940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+5:5841:x1874634253284736:12345-0@lo:104: Request processed in 20us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790629.737585:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787790629.737591:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787790629.737594:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53cced00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+4:5841:x1874634253284864:12345-0@lo:104: 00010000:00010000:2.0:1787790629.737598:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa97740a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97740ac expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737609:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787790629.737612:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53cced00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+4:5841:x1874634253284864:12345-0@lo:104: Request processed in 18us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790629.737620:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787790629.737627:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787790629.737630:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:5841:x1874634253284992:12345-0@lo:104: 00010000:00010000:2.0:1787790629.737634:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa977407b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9774082 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737649:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787790629.737652:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:5841:x1874634253284992:12345-0@lo:104: Request processed in 22us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790629.737655:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787790629.737665:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787790629.737670:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a40030a00/0x70647b5fa9774115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa977411c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737677:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030a00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:2.0:1787790629.737681:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a40030a00/0x70647b5fa9774115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa977411c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737689:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a40030a00/0x70647b5fa9774115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa977411c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790629.737696:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a40030a00/0x70647b5fa9774115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa977411c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790629.737701:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787790629.737747:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a40030a00/0x70647b5fa9774115 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa977411c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737754:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790629.737779:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a40030a00/0x70647b5fa9774115 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa977411c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737787:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a40030a00/0x70647b5fa9774115 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa977411c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737798:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787790629.737800:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa97740eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97740f2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737804:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f0e00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:2.0:1787790629.737806:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa97740eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa97740f2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737810:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa97740eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa97740f2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790629.737814:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa97740eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa97740f2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790629.737817:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787790629.737826:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa97740eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97740f2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737830:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790629.737840:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa97740eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97740f2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737844:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa97740eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97740f2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737849:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787790629.737855:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a542f1600/0x70647b5fa97740cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97740d6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737858:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f1600 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:2.0:1787790629.737860:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a542f1600/0x70647b5fa97740cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa97740d6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737864:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a542f1600/0x70647b5fa97740cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa97740d6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790629.737868:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a542f1600/0x70647b5fa97740cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa97740d6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790629.737871:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787790629.737886:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a542f1600/0x70647b5fa97740cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97740d6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737890:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790629.737893:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a542f1600/0x70647b5fa97740cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97740d6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737897:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a542f1600/0x70647b5fa97740cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97740d6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737902:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787790629.737904:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa97740a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97740ac expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737907:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479e00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:2.0:1787790629.737909:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa97740a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa97740ac expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737919:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa97740a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa97740ac expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790629.737923:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa97740a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa97740ac expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790629.737925:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787790629.737944:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa97740a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97740ac expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737949:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790629.737955:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa97740a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97740ac expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737960:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a41479e00/0x70647b5fa97740a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97740ac expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737969:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790629.737972:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa977407b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9774082 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737977:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479000 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:2.0:1787790629.737980:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa977407b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa9774082 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.737986:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa977407b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa9774082 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790629.737993:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa977407b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa9774082 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790629.738003:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787790629.738012:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa977407b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774082 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738016:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790629.738019:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa977407b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774082 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738023:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa977407b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774082 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738031:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790629.738032:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790629.738033:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790629.738052:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253285120:0@lo:103: 00000100:00100000:2.0:1787790629.738079:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790629.738098:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253285632:0@lo:103: 00000100:00100000:2.0:1787790629.738112:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790629.738125:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787790629.738128:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253285504:0@lo:103: 00000100:00100000:2.0:1787790629.738138:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790629.738153:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253285248:0@lo:103: 00000100:00100000:2.0:1787790629.738175:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790629.738183:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787790629.738186:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253285376:0@lo:103: 00000100:00100000:2.0:1787790629.738195:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790629.738214:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253285120 00000100:00100000:2.0:1787790629.738220:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253285120 00010000:00010000:2.0:1787790629.738234:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a40030200/0x70647b5fa977411c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9774115 expref: 17 pid: 5841 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790629.738244:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253285632 00000100:00100000:2.0:1787790629.738245:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253285632 00010000:00010000:2.0:1787790629.738250:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a542f1e00/0x70647b5fa9774082 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa977407b expref: 18 pid: 5840 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790629.738255:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253285504 00000100:00100000:2.0:1787790629.738256:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253285504 00010000:00010000:2.0:1787790629.738261:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a542f1000/0x70647b5fa97740ac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97740a5 expref: 19 pid: 5841 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790629.738265:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253285248 00000100:00100000:2.0:1787790629.738267:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253285248 00010000:00010000:2.0:1787790629.738271:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a40030000/0x70647b5fa97740f2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97740eb expref: 20 pid: 5840 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790629.738276:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253285376 00000100:00100000:2.0:1787790629.738277:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253285376 00010000:00010000:2.0:1787790629.738281:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a41479800/0x70647b5fa97740d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97740cf expref: 21 pid: 5841 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790629.738287:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787790629.738290:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db68f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+21:3321:x1874634253285120:12345-0@lo:103: 00010000:00010000:2.0:1787790629.738297:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790629.738300:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a40030200/0x70647b5fa977411c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9774115 expref: 21 pid: 5841 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738307:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a40030200/0x70647b5fa977411c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa9774115 expref: 21 pid: 5841 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738326:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790629.738344:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db68f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+21:3321:x1874634253285120:12345-0@lo:103: Request processed in 53us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790629.738348:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787790629.738357:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787790629.738361:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db692c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+20:3321:x1874634253285632:12345-0@lo:103: 00010000:00010000:2.0:1787790629.738366:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790629.738368:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a542f1e00/0x70647b5fa9774082 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa977407b expref: 20 pid: 5840 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738373:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a542f1e00/0x70647b5fa9774082 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa977407b expref: 20 pid: 5840 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738379:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790629.738389:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db692c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+20:3321:x1874634253285632:12345-0@lo:103: Request processed in 29us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790629.738393:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787790629.738399:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787790629.738402:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3321:x1874634253285504:12345-0@lo:103: 00010000:00010000:2.0:1787790629.738406:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790629.738408:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a542f1000/0x70647b5fa97740ac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97740a5 expref: 19 pid: 5841 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738413:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a542f1000/0x70647b5fa97740ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa97740a5 expref: 19 pid: 5841 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738418:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790629.738427:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3321:x1874634253285504:12345-0@lo:103: Request processed in 25us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790629.738437:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787790629.738448:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787790629.738453:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:3318:x1874634253285248:12345-0@lo:103: 00010000:00010000:2.0:1787790629.738460:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790629.738464:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a40030000/0x70647b5fa97740f2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97740eb expref: 18 pid: 5840 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738471:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a40030000/0x70647b5fa97740f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa97740eb expref: 18 pid: 5840 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738492:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790629.738516:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:3318:x1874634253285248:12345-0@lo:103: Request processed in 64us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790629.738520:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787790629.738528:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787790629.738532:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:3318:x1874634253285376:12345-0@lo:103: 00010000:00010000:2.0:1787790629.738537:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790629.738539:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a41479800/0x70647b5fa97740d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97740cf expref: 17 pid: 5841 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738545:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a41479800/0x70647b5fa97740d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa97740cf expref: 17 pid: 5841 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738553:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff931a41479200/0x70647b5fa9774131 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738558:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a41479200/0x70647b5fa9774131 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738573:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a41479200/0x70647b5fa9774131 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738578:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a41479200/0x70647b5fa9774131 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738582:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff931a41479200/0x70647b5fa9774131 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738586:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff931a41479200/0x70647b5fa9774131 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738589:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479200 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:2.0:1787790629.738592:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff931a41479200/0x70647b5fa9774131 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738596:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff931a41479200/0x70647b5fa9774131 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738600:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff931a41479200/0x70647b5fa9774131 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.738606:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790629.738620:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:3318:x1874634253285376:12345-0@lo:103: Request processed in 88us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790629.738623:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787790629.738649:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253285376:0@lo:103: 00000100:00100000:2.0:1787790629.738654:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253285248:0@lo:103: 00000100:00100000:2.0:1787790629.738674:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253285504:0@lo:103: 00000100:00100000:2.0:1787790629.738689:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253285120:0@lo:103: 00000100:00100000:2.0:1787790629.738696:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253285632:0@lo:103: 00010000:00010000:3.0:1787790629.738846:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a40030200/0x70647b5fa977411c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa9774115 expref: 16 pid: 5841 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790629.738855:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456d8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874634253284480:0@lo:104: 00010000:00010000:3.0:1787790629.738860:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a40030000/0x70647b5fa97740f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa97740eb expref: 15 pid: 5840 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790629.738865:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456dbc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874634253284608:0@lo:104: 00010000:00010000:3.0:1787790629.738869:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a41479800/0x70647b5fa97740d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa97740cf expref: 14 pid: 5841 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790629.738873:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456d8b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874634253284736:0@lo:104: 00010000:00010000:3.0:1787790629.738877:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a542f1000/0x70647b5fa97740ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa97740a5 expref: 13 pid: 5841 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790629.738882:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456d8f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874634253284864:0@lo:104: 00010000:00010000:3.0:1787790629.738886:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a542f1e00/0x70647b5fa9774082 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa977407b expref: 12 pid: 5840 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790629.738891:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456d92c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874634253284992:0@lo:104: 00010000:00010000:3.0:1787790629.738903:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff931a41479200/0x70647b5fa9774131 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790629.738909:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff931a41479200/0x70647b5fa9774131 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790629.738917:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff931a41479200/0x70647b5fa9774131 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790629.738921:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a41479200/0x70647b5fa9774131 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787790629.738929:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:1.0:1787790629.739323:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790629.790234:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:7614:x1874634253284352:12345-0@lo:253: Request processed in 64770us (64897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790629.790250:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787790629.790307:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f07840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253284352:0@lo:253: 10000000:01000000:0.0:1787790629.790330:0:7614:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787790629.790333:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787790629.790335:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787790629.790336:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787790629.790338:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787790629.790339:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787790629.790341:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787790629.790342:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787790629.790344:0:7614:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787790629.790346:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787790629.790347:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787790629.790366:0:7614:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9319447e6800 from lustre-OST0001 10000000:01000000:0.0:1787790629.790394:0:7614:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787790629.790396:0:7614:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787790629.790404:0:7614:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff931a44ec4d28 local copy 10000000:01000000:0.0:1787790629.790408:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787790629.790443:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa9774138 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790629.790455:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa9774138 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790629.790491:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa9774138 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790629.790511:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53eea1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253285760:0@lo:101: 00000100:00100000:0.0:1787790629.790546:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790629.790581:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff931946508780 going to sleep for 11 seconds 00000100:00100000:2.0:1787790629.790602:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253285760 00000100:00100000:2.0:1787790629.790608:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253285760 00000100:00100000:2.0:1787790629.790652:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787790629.790661:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:7614:x1874634253285760:12345-0@lo:101: 00010000:00010000:2.0:1787790629.790684:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790629.790697:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a542f1600/0x70647b5fa977413f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9774138 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.790720:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a542f1600/0x70647b5fa977413f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9774138 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.790765:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a542f1600/0x70647b5fa977413f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9774138 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.790774:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f1600, rc 0) 00000100:00100000:2.0:1787790629.790809:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:7614:x1874634253285760:12345-0@lo:101: Request processed in 149us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790629.790815:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787790629.790828:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53eea1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253285760:0@lo:101: 00010000:00010000:0.0:1787790629.790840:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa9774138 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x70647b5fa977413f expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790629.790861:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa9774138 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x70647b5fa977413f expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790629.790963:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53eea1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253285888:0@lo:501: 00000100:00100000:0.0:1787790629.790988:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790629.791012:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff931946508780 going to sleep for 11 seconds 00000100:00100000:2.0:1787790629.791024:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253285888 00000100:00100000:2.0:1787790629.791028:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253285888 00000100:00100000:2.0:1787790629.791063:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787790629.791070:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:7614:x1874634253285888:12345-0@lo:501: 00000100:00100000:2.0:1787790629.791263:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:7614:x1874634253285888:12345-0@lo:501: Request processed in 193us (274us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787790629.791270:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787790629.791332:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53eea1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253285888:0@lo:501: 10000000:01000000:3.0:1787790629.791346:0:7614:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787790629.791371:0:7614:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787790629.791376:0:7614:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa9774138 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x70647b5fa977413f expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790629.791385:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa9774138 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x70647b5fa977413f expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790629.791392:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa9774138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x70647b5fa977413f expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790629.791413:0:7614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787790629.791433:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9319447e6800 10000000:01000000:3.0:1787790629.791437:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787790629.791441:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787790629.791444:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787790629.791448:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787790629.791451:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787790629.791453:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790629.791459:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa9774138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x70647b5fa977413f expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790629.791465:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa9774146 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790629.791494:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa9774146 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.791494:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030000 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:2.0:1787790629.791498:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa9774138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x70647b5fa977413f expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790629.791503:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa9774146 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.791507:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa9774138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0x70647b5fa977413f expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790629.791514:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa9774138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x70647b5fa977413f expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790629.791515:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253286016:0@lo:101: 10000000:01000000:2.0:1787790629.791520:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787790629.791537:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa9774138 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x70647b5fa977413f expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790629.791542:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790629.791543:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787790629.791567:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47a34900 going to sleep for 11 seconds 00010000:00010000:2.0:1787790629.791569:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa9774138 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x70647b5fa977413f expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.791576:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa9774138 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x70647b5fa977413f expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.791589:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790629.791590:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790629.791598:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790629.791606:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787790629.791617:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253286144:0@lo:103: 00000100:00100000:2.0:1787790629.791643:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790629.792025:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253286144 00000100:00100000:3.0:1787790629.792030:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253286144 00000100:00100000:3.0:1787790629.792071:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790629.792079:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:3319:x1874634253286144:12345-0@lo:103: 00010000:00010000:3.0:1787790629.792090:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790629.792102:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a542f1600/0x70647b5fa977413f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70647b5fa9774138 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790629.792115:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790629.792153:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:3319:x1874634253286144:12345-0@lo:103: Request processed in 75us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790629.792160:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787790629.792417:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253286144:0@lo:103: 00000100:00100000:0.0:1787790629.793926:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253286016 00000100:00100000:0.0:1787790629.793948:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253286016 00000100:00100000:0.0:1787790629.794000:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787790629.794010:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+11:7614:x1874634253286016:12345-0@lo:101: 00010000:00010000:0.0:1787790629.794024:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790629.794041:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a40030200/0x70647b5fa977414d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9774146 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790629.794063:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a40030200/0x70647b5fa977414d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9774146 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790629.794089:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a40030200/0x70647b5fa977414d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9774146 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790629.794098:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a40030200, rc 0) 00000100:00100000:0.0:1787790629.794155:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:7614:x1874634253286016:12345-0@lo:101: Request processed in 147us (2611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790629.794162:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787790629.794359:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253286016:0@lo:101: 00010000:00010000:3.0:1787790629.794377:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa9774146 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977414d expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790629.794386:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa9774146 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa977414d expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790629.794513:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253286272:0@lo:501: 00000100:00100000:3.0:1787790629.794560:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790629.794594:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253286272 00000100:00100000:3.0:1787790629.794596:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47a34900 going to sleep for 11 seconds 00000100:00100000:2.0:1787790629.794599:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253286272 00000100:00100000:2.0:1787790629.794633:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787790629.794641:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:7614:x1874634253286272:12345-0@lo:501: 00000100:00100000:2.0:1787790629.794900:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:7614:x1874634253286272:12345-0@lo:501: Request processed in 259us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790629.794906:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787790629.796108:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253286272:0@lo:501: 00000100:00100000:3.0:1787790629.796157:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253286400:0@lo:503: 00000100:00100000:3.0:1787790629.796213:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790629.796256:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47a34900 going to sleep for 11 seconds 00000100:00100000:2.0:1787790629.796315:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253286400 00000100:00100000:2.0:1787790629.796322:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253286400 00000100:00100000:2.0:1787790629.796365:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787790629.796374:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:7614:x1874634253286400:12345-0@lo:503: 00000100:00100000:2.0:1787790629.796577:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:7614:x1874634253286400:12345-0@lo:503: Request processed in 203us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790629.796584:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787790629.796710:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253286400:0@lo:503: 00000040:00080000:3.0:1787790629.797018:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787790629.797071:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253286528:0@lo:502: 00000100:00100000:3.0:1787790629.797107:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790629.797136:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47a34900 going to sleep for 11 seconds 00000100:00100000:0.0:1787790629.797192:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253286528 00000100:00100000:0.0:1787790629.797197:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253286528 00000100:00100000:0.0:1787790629.797231:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787790629.797238:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:7614:x1874634253286528:12345-0@lo:502: 00000100:00100000:0.0:1787790629.797383:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:7614:x1874634253286528:12345-0@lo:502: Request processed in 145us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790629.797389:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787790629.797490:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253286528:0@lo:502: 00000040:00080000:1.0:1787790629.797709:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787790629.797797:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787790629.797831:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787790629.797880:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787790629.797917:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787790629.797947:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787790629.797972:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456db480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253286656:0@lo:502: 00000100:00100000:1.0:1787790629.798012:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790629.798046:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d815900 going to sleep for 11 seconds 00000100:00100000:2.0:1787790629.798460:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253286656 00000100:00100000:2.0:1787790629.798465:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253286656 00000100:00100000:2.0:1787790629.798514:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787790629.798522:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:7614:x1874634253286656:12345-0@lo:502: 00000100:00100000:2.0:1787790629.798680:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:7614:x1874634253286656:12345-0@lo:502: Request processed in 159us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790629.798687:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787790629.798746:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456db480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253286656:0@lo:502: 00000040:00080000:1.0:1787790629.798839:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787790629.798857:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1787790629.799462:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787790629.799470:0:7621:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787790629.799486:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790629.799489:0:7621:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787790629.799496:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787790629.799511:0:7621:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff931a44ec19b8) 00000020:00000080:0.0:1787790629.799533:0:7621:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787790629.799539:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787790629.799596:0:7621:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9319447e6800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787790629.799604:0:7621:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787790629.799610:0:7621:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x70647b5fa977415b 00010000:00010000:1.0:1787790629.804276:0:7621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1787790629.804568:0:7621:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787790629.807917:0:7621:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787790629.808233:0:7621:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787790629.812323:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787790629.812882:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787790629.815090:0:7621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787790629.815109:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790629.815116:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790629.815118:0:7621:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787790629.815121:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790629.815125:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790629.815126:0:7621:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787790629.815128:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787790629.815130:0:7621:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787790629.815182:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790629.815185:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790629.815187:0:7621:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787790629.815190:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787790629.815451:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787790629.815491:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787790629.815515:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa9774146 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977414d expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.815528:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa9774146 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977414d expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790629.815546:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9319447e6800 from 1 10000000:01000000:1.0:1787790629.815549:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787790629.815585:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774162 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.815593:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774162 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.815606:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774162 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790629.815628:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456db480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253286784:0@lo:101: 00000100:00100000:1.0:1787790629.815694:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790629.815763:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d8159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790629.816513:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253286784 00000100:00100000:0.0:1787790629.816522:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253286784 00000100:00100000:0.0:1787790629.816576:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787790629.816586:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:7614:x1874634253286784:12345-0@lo:101: 00010000:00010000:0.0:1787790629.816604:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790629.816617:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a40030a00/0x70647b5fa9774169 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9774162 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790629.816639:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a40030a00/0x70647b5fa9774169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9774162 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790629.816650:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a40030a00/0x70647b5fa9774169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9774162 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790629.816658:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a40030a00, rc 0) 00000100:00100000:0.0:1787790629.816711:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:7614:x1874634253286784:12345-0@lo:101: Request processed in 126us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790629.816718:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787790629.816840:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456db480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253286784:0@lo:101: 00010000:00010000:3.0:1787790629.816855:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774162 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774169 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790629.816865:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774162 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9774169 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790629.817022:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253286912:0@lo:501: 00000100:00100000:3.0:1787790629.817050:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790629.817121:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47a34d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790629.817446:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253286912 00000100:00100000:0.0:1787790629.817450:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253286912 00000100:00100000:0.0:1787790629.817490:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787790629.817498:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46533850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:7614:x1874634253286912:12345-0@lo:501: 00000100:00100000:0.0:1787790629.817705:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46533850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:7614:x1874634253286912:12345-0@lo:501: Request processed in 207us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790629.817713:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787790629.817796:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253286912:0@lo:501: 00000100:00100000:3.0:1787790629.817828:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253287040:0@lo:503: 00000100:00100000:3.0:1787790629.818023:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790629.818035:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47a34d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787790629.818050:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253287040 00000100:00100000:3.0:1787790629.818054:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253287040 00000100:00100000:3.0:1787790629.818074:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787790629.818079:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46532850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:7614:x1874634253287040:12345-0@lo:503: 00000100:00100000:3.0:1787790629.818360:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46532850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:7614:x1874634253287040:12345-0@lo:503: Request processed in 280us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790629.818368:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787790629.818409:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253287040:0@lo:503: 00000040:00080000:3.0:1787790629.818669:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787790629.818746:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253287168:0@lo:502: 00000100:00100000:3.0:1787790629.818780:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790629.818796:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47a34d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787790629.818810:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253287168 00000100:00100000:3.0:1787790629.818814:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253287168 00000100:00100000:3.0:1787790629.818844:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787790629.818850:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:7614:x1874634253287168:12345-0@lo:502: 00000100:00100000:3.0:1787790629.820179:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:7614:x1874634253287168:12345-0@lo:502: Request processed in 1323us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790629.820191:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787790629.820318:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253287168:0@lo:502: 00000040:00080000:0.0:1787790629.820627:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787790629.820685:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787790629.820720:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53eeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253287296:0@lo:502: 00000100:00100000:0.0:1787790629.829301:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790629.829343:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff931946508840 going to sleep for 11 seconds 00000100:00100000:3.0:1787790629.830670:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253287296 00000100:00100000:3.0:1787790629.830683:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253287296 00000100:00100000:3.0:1787790629.830800:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787790629.830811:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:7614:x1874634253287296:12345-0@lo:502: 00000100:00100000:3.0:1787790629.831091:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:7614:x1874634253287296:12345-0@lo:502: Request processed in 281us (1793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790629.831109:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787790629.831128:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53eeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253287296:0@lo:502: 00000040:00080000:1.0:1787790629.831289:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787790629.831305:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787790629.832372:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787790629.832383:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790629.832386:0:7625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787790629.832392:0:7625:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9319447e6800 00000020:00000080:1.0:1787790629.832395:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787790629.832416:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787790629.832419:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790629.832420:0:7625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787790629.832423:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787790629.832627:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787790629.832651:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787790629.832682:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774162 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774169 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.832694:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774162 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774169 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790629.832768:0:7614:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787790629.832772:0:7614:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9319447e6800 10000000:01000000:2.0:1787790629.832775:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9319447e6800 10000000:01000000:2.0:1787790629.832778:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787790629.832784:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9319447e6800 from 1 10000000:01000000:2.0:1787790629.832787:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787790629.832818:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa9774170 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.832828:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa9774170 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.832838:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa9774170 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790629.832872:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db68b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253287424:0@lo:101: 00000100:00100000:2.0:1787790629.832927:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790629.840813:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253287424 00000100:00100000:0.0:1787790629.840844:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253287424 00000100:00100000:2.0:1787790629.841678:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a488cb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790629.841699:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787790629.841710:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46533450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:7614:x1874634253287424:12345-0@lo:101: 00010000:00010000:0.0:1787790629.841741:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790629.841759:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a40030e00/0x70647b5fa9774177 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9774170 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790629.841787:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a40030e00/0x70647b5fa9774177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9774170 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790629.841799:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a40030e00/0x70647b5fa9774177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9774170 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790629.841808:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a40030e00, rc 0) 00000100:00100000:0.0:1787790629.842062:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46533450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:7614:x1874634253287424:12345-0@lo:101: Request processed in 352us (9132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790629.842069:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787790629.842232:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db68b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253287424:0@lo:101: 00010000:00010000:2.0:1787790629.842250:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa9774170 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774177 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.842261:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa9774170 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9774177 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790629.842370:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db68b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253287552:0@lo:501: 00000100:00100000:2.0:1787790629.842406:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790629.842422:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a488cb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790629.842474:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253287552 00000100:00100000:0.0:1787790629.842489:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253287552 00000100:00100000:0.0:1787790629.842519:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787790629.842528:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46533c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:7614:x1874634253287552:12345-0@lo:501: 00000100:00100000:0.0:1787790629.842776:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46533c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:7614:x1874634253287552:12345-0@lo:501: Request processed in 248us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790629.842783:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787790629.846209:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db68b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253287552:0@lo:501: 00000100:00100000:2.0:1787790629.846275:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db68b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253287680:0@lo:503: 00000100:00100000:2.0:1787790629.846356:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790629.846391:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a488cb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790629.846902:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253287680 00000100:00100000:3.0:1787790629.846908:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253287680 00000100:00100000:3.0:1787790629.846953:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787790629.846964:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46531450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:7614:x1874634253287680:12345-0@lo:503: 00000100:00100000:3.0:1787790629.847167:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46531450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:7614:x1874634253287680:12345-0@lo:503: Request processed in 205us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790629.847174:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787790629.847225:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db68b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253287680:0@lo:503: 00000040:00080000:3.0:1787790629.847516:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787790629.847584:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f07840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253287808:0@lo:502: 00000100:00100000:3.0:1787790629.847626:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790629.847639:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47a34b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790629.847663:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253287808 00000100:00100000:3.0:1787790629.847667:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253287808 00000100:00100000:3.0:1787790629.847686:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787790629.847692:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46530c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:7614:x1874634253287808:12345-0@lo:502: 00000100:00100000:3.0:1787790629.847886:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46530c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:7614:x1874634253287808:12345-0@lo:502: Request processed in 193us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790629.847893:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787790629.847926:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f07840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253287808:0@lo:502: 00000040:00080000:3.0:1787790629.848191:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787790629.848237:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787790629.848273:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787790629.848330:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787790629.848370:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787790629.848429:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787790629.848466:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787790629.848518:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787790629.848566:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787790629.848603:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787790629.848637:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787790629.848690:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787790629.848753:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787790629.848790:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787790629.848838:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787790629.848874:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787790629.848907:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787790629.848976:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787790629.849014:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787790629.849049:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787790629.849097:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787790629.849134:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787790629.849167:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787790629.849215:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787790629.849251:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787790629.849286:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787790629.849346:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787790629.849380:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1787790629.849414:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787790629.849462:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1787790629.849514:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1787790629.849550:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1787790629.849584:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1787790629.849633:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1787790629.849669:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1787790629.849717:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1787790629.849784:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1787790629.849827:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f07840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253287936:0@lo:502: 00000100:00100000:3.0:1787790629.849899:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790629.849919:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47a34b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790629.849958:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253287936 00000100:00100000:3.0:1787790629.849965:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253287936 00000100:00100000:3.0:1787790629.849995:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787790629.850002:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46531850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:7614:x1874634253287936:12345-0@lo:502: 00000100:00100000:3.0:1787790629.850201:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46531850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:7614:x1874634253287936:12345-0@lo:502: Request processed in 198us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790629.850209:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787790629.850263:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f07840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253287936:0@lo:502: 00000040:00080000:3.0:1787790629.850324:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1787790629.850333:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787790629.859587:0:7626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787790629.859606:0:7626:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff931a44ec3370) 00000020:00000080:0.0:1787790629.859628:0:7626:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1787790629.862391:0:7626:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9319447e6800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787790629.862406:0:7626:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9319447e6800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787790629.862425:0:7626:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9319447e6800 3 00010000:00080000:0.0:1787790629.862493:0:7626:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93194645c800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.125@tcp at head 00010000:00010000:0.0:1787790629.865443:0:7626:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1787790629.865659:0:7626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787790629.865703:0:7626:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787790629.865717:0:7626:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x70647b5fa9774185 00000100:00080000:0.0:1787790629.865753:0:7626:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787790629.865760:0:7626:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93194645c800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1787790629.865799:0:7626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931a53ee83c0 x1874634253288064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787790629.865839:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1874634253288064:0@lo:38: 00000100:00100000:1.0:1787790629.865925:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790629.865972:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253288064 00000100:00100000:2.0:1787790629.865979:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253288064 00000100:00100000:2.0:1787790629.866008:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787790629.866015:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1874634253288064:12345-0@lo:38: 00010000:00080000:2.0:1787790629.866038:0:5846:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:2.0:1787790629.866070:0:5846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x70647b5fa977418c 00000004:00100000:2.0:1787790629.866083:0:5846:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787790629.866111:0:5846:0:(import.c:65:import_set_state_nolock()) ffff931a7db5f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787790629.866175:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874634253288064:12345-0@lo:38: Request processed in 158us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790629.866183:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787790629.866229:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a53ee83c0 x1874634253288064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787790639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790629.866239:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787790629.866247:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787790629.866254:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787790629.866258:0:3317:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787790629.866260:0:3317:0:(import.c:65:import_set_state_nolock()) ffff93194645c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787790629.866266:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1874634253288064:0@lo:38: 00000100:00080000:0.0:1787790629.874804:0:7626:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787790629.874997:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253288320:0@lo:400: 00000100:00100000:3.0:1787790629.875079:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790629.875118:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790629.875127:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253288448:0@lo:400: 00000100:00100000:3.0:1787790629.875170:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790629.875205:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253288320 00000100:00100000:3.0:1787790629.875212:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253288320 00000100:00100000:3.0:1787790629.875272:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787790629.875282:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53f07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253288320:12345-0@lo:400: 00000100:00100000:3.0:1787790629.875332:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53f07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253288320:12345-0@lo:400: Request processed in 52us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790629.875339:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787790629.875366:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253288448 00000100:00100000:3.0:1787790629.875370:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253288448 00000100:00100000:3.0:1787790629.875396:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787790629.875412:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53f04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253288448:12345-0@lo:400: 00000100:00100000:3.0:1787790629.875444:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53f04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253288448:12345-0@lo:400: Request processed in 36us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790629.875450:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787790629.875466:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787790629.875470:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787790629.875512:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a53f05e00 x1874634253288448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790629.875526:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253288448:0@lo:400: 00010000:00080000:3.0:1787790629.875538:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a53f052c0 x1874634253288320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790629.875544:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253288320:0@lo:400: 00000100:00100000:1.0:1787790629.875672:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790629.875683:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253288192:0@lo:400: 00000100:00100000:1.0:1787790629.875712:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1787790629.876642:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1787790629.876861:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456db480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7628:1874634253288576:0@lo:901: 00000100:00100000:1.0:1787790629.876905:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790629.876931:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d815f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787790629.877118:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253288192 00000100:00100000:3.0:1787790629.877124:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253288192 00000100:00100000:3.0:1787790629.877171:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787790629.877180:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253288192:12345-0@lo:400: 00000100:00100000:3.0:1787790629.877231:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253288192:12345-0@lo:400: Request processed in 52us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790629.877237:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787790629.877271:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a53f07840 x1874634253288192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790629.877284:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253288192:0@lo:400: 00000020:01000000:3.0:1787790629.877309:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787790629.877332:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787790629.877347:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa9774170 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774177 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790629.877366:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa9774170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774177 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787790629.877421:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787790629.877424:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787790629.877425:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787790629.877427:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787790629.877428:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787790629.877429:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787790629.877431:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787790629.877432:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787790629.877433:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787790629.877435:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787790629.877436:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787790629.877440:0:7614:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1787790629.877442:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787790629.877444:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787790629.877445:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787790629.877446:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787790629.877447:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787790629.877448:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787790629.877449:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787790629.877450:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787790629.877451:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787790629.877452:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787790629.877453:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787790629.877468:0:7614:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787790629.877488:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f07840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253288704:0@lo:253: 00000100:00100000:3.0:1787790629.877533:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790629.877556:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47a34b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790629.877571:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253288704 00000100:00100000:3.0:1787790629.877574:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253288704 00000100:00100000:3.0:1787790629.877599:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787790629.877607:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46530850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:7614:x1874634253288704:12345-0@lo:253: 20000000:01000000:3.0:1787790629.877633:0:5841:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787790629.877646:0:5841:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787790629.878829:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253288576 00000100:00100000:0.0:1787790629.878839:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253288576 00000100:00100000:0.0:1787790629.878892:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790629.878899:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7628:x1874634253288576:12345-0@lo:901: 00000100:00080000:3.0:1787790629.880170:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790629.881153:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7628:x1874634253288576:12345-0@lo:901: Request processed in 2248us (4241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790629.881166:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787790629.884768:0:7628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a456db480 x1874634253288576/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787790645 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790629.884787:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456db480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7628:1874634253288576:0@lo:901: 20000000:01000000:2.0:1787790629.929540:0:5841:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787790629.929563:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787790629.929632:0:5862:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787790629.929637:0:5862:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787790629.929658:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff931a40031400/0x70647b5fa9774193 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790629.929679:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a40030400/0x70647b5fa97740e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97740dd expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790629.929688:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff931a40031400/0x70647b5fa9774193 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790629.929768:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a40030400/0x70647b5fa97740e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa97740dd expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790629.929784:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a40030400/0x70647b5fa97740e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa97740dd expref: 14 pid: 5840 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790629.929797:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee8780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1874634253288832:0@lo:104: 00000100:00100000:0.0:1787790629.929875:0:5862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790629.929923:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67cd1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787790629.929940:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253288832 00000100:00100000:3.0:1787790629.929949:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253288832 00000100:00100000:3.0:1787790629.930042:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787790629.930053:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ee9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:5862:x1874634253288832:12345-0@lo:104: 00010000:00010000:3.0:1787790629.930067:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97740dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97740e4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790629.930129:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787790629.930135:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ee9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:5862:x1874634253288832:12345-0@lo:104: Request processed in 85us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790629.930141:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787790629.930209:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee8780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1874634253288832:0@lo:104: 00010000:00010000:0.0:1787790629.930227:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff931a40031400/0x70647b5fa9774193 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.933747:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790629.933763:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97740dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97740e4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.933776:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f1400 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:1.0:1787790629.933780:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97740dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa97740e4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.933791:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97740dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa97740e4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790629.933815:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97740dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa97740e4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790629.933821:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787790629.933888:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97740dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97740e4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.933895:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790629.933916:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97740dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97740e4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.933924:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97740dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97740e4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.933943:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790629.933945:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790629.933946:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790629.933965:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253288960:0@lo:103: 00000100:00100000:1.0:1787790629.934031:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790629.934103:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253288960 00000100:00100000:1.0:1787790629.934111:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253288960 00010000:00010000:1.0:1787790629.934141:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a40030400/0x70647b5fa97740e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97740dd expref: 15 pid: 5840 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790629.934172:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787790629.934181:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a493ce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:3318:x1874634253288960:12345-0@lo:103: 00010000:00010000:1.0:1787790629.934196:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790629.934202:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a40030400/0x70647b5fa97740e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97740dd expref: 15 pid: 5840 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.934222:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a40030400/0x70647b5fa97740e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa97740dd expref: 15 pid: 5840 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.934238:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a40030400/0x70647b5fa97740e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa97740dd expref: 15 pid: 5840 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.934255:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff931a40031400/0x70647b5fa9774193 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.934264:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a40031400/0x70647b5fa9774193 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787790629.934281:0:5831:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004644180s 00010000:00010000:1.0:1787790629.934285:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a40031400/0x70647b5fa9774193 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.934292:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a40031400/0x70647b5fa9774193 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.934299:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff931a40031400/0x70647b5fa9774193 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.934306:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff931a40031400/0x70647b5fa9774193 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.934311:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40031400 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790629.934314:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff931a40031400/0x70647b5fa9774193 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.934322:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff931a40031400/0x70647b5fa9774193 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.934353:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff931a40031400/0x70647b5fa9774193 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790629.934364:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790629.934400:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a493ce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:3318:x1874634253288960:12345-0@lo:103: Request processed in 220us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790629.934408:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787790629.934470:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253288960:0@lo:103: 00010000:00010000:2.0:1787790629.934575:0:5862:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff931a40031400/0x70647b5fa9774193 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.934585:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff931a40031400/0x70647b5fa9774193 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790629.934605:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a40031400/0x70647b5fa9774193 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790629.937680:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46530850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:7614:x1874634253288704:12345-0@lo:253: Request processed in 60065us (60138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790629.937696:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787790629.939098:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f07840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7614:1874634253288704:0@lo:253: 10000000:01000000:1.0:1787790629.939117:0:7614:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787790629.939120:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787790629.939122:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787790629.939123:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790629.939125:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790629.939126:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790629.939127:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790629.939129:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787790629.939130:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787790629.939131:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787790629.939133:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790629.939134:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787790629.939149:0:7614:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787790629.944499:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787790629.944717:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787790629.947966:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787790629.948252:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787790629.948511:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787790629.950273:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787790629.957293:0:7614:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787790630.256608:0:7614:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787790630.256621:0:7614:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787790630.256661:0:7614:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787790630.256751:0:7614:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.125@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787790630.256769:0:7614:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787790630.256802:0:7614:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787790630.656609:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790630.976330:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253289088:0@lo:13: 00000100:00100000:2.0:1787790630.976402:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790630.976526:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253289088 00000100:00100000:1.0:1787790630.976534:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253289088 00000100:00100000:1.0:1787790630.976583:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787790630.976592:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253289088:12345-0@lo:13: 00002000:00000024:1.0:1787790630.976633:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787790630.976682:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253289088:12345-0@lo:13: Request processed in 91us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790630.976690:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787790630.976747:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a456db480 x1874634253289088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790646 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790630.976765:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253289088:0@lo:13: 00010000:00010000:1.0:1787790631.680098:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790632.705087:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790633.731503:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790634.757560:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790635.072830:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53eebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253289344:0@lo:400: 00000100:00100000:0.0:1787790635.072899:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790635.072966:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787790635.072973:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253289216:0@lo:400: 00000100:00100000:0.0:1787790635.073005:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790635.073039:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1874634253289728:0@lo:400: 00000100:00100000:0.0:1787790635.073068:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790635.073094:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253289472:0@lo:400: 00000100:00100000:0.0:1787790635.073133:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790635.073151:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787790635.073157:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53eea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253289600:0@lo:400: 00000100:00100000:0.0:1787790635.073182:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790635.073217:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253289344 00000100:00100000:0.0:1787790635.073225:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253289344 00000100:00100000:0.0:1787790635.073476:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253289728 00000100:00100000:0.0:1787790635.073480:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253289728 00000100:00100000:0.0:1787790635.073506:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253289472 00000100:00100000:0.0:1787790635.073509:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253289472 00000100:00100000:0.0:1787790635.073527:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787790635.073536:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ee83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253289344:12345-0@lo:400: 00000100:00100000:0.0:1787790635.073593:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ee83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253289344:12345-0@lo:400: Request processed in 57us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790635.073601:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787790635.073618:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787790635.073624:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53eeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874634253289728:12345-0@lo:400: 00000100:00100000:0.0:1787790635.073652:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53eeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874634253289728:12345-0@lo:400: Request processed in 29us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790635.073660:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787790635.073672:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787790635.073678:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53eea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253289472:12345-0@lo:400: 00000100:00100000:0.0:1787790635.073708:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53eea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253289472:12345-0@lo:400: Request processed in 30us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790635.073755:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787790635.073776:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253289216 00000100:00100000:0.0:1787790635.073779:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253289216 00000100:00100000:0.0:1787790635.073805:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787790635.073812:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45663450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:3321:x1874634253289216:12345-0@lo:400: 00000100:00100000:0.0:1787790635.073841:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45663450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:3321:x1874634253289216:12345-0@lo:400: Request processed in 29us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790635.073848:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787790635.073881:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253289600 00000100:00100000:0.0:1787790635.073885:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253289600 00000100:00100000:0.0:1787790635.073914:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787790635.073920:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53eead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253289600:12345-0@lo:400: 00000100:00100000:0.0:1787790635.073951:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53eead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253289600:12345-0@lo:400: Request processed in 32us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790635.073958:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787790635.073974:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787790635.073978:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787790635.074013:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a53eea580 x1874634253289600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790635.074026:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53eea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253289600:0@lo:400: 00010000:00080000:0.0:1787790635.074037:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a53ee92c0 x1874634253289472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790635.074045:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253289472:0@lo:400: 00000100:00100000:0.0:1787790635.074074:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253289216:0@lo:400: 00010000:00080000:0.0:1787790635.074084:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a53ee8780 x1874634253289728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790635.074100:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1874634253289728:0@lo:400: 00010000:00080000:0.0:1787790635.074534:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a53eebc00 x1874634253289344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790635.074544:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53eebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253289344:0@lo:400: 00010000:00010000:0.0:1787790635.782653:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790636.095992:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253289856:0@lo:13: 00000100:00100000:0.0:1787790636.096215:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790636.097114:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253289856 00000100:00100000:2.0:1787790636.097125:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253289856 00000100:00100000:2.0:1787790636.097176:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787790636.097186:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53eebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253289856:12345-0@lo:13: 00002000:00000024:2.0:1787790636.097237:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787790636.097298:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53eebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253289856:12345-0@lo:13: Request processed in 113us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790636.097306:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787790636.097353:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a456dbc00 x1874634253289856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790652 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790636.097391:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253289856:0@lo:13: 10000000:01000000:3.0:1787790636.615695:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787790636.615703:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff931a493ae800 from 30 10000000:01000000:3.0:1787790636.615708:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787790636.615766:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a52848a00/0x70647b5fa977419a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790636.615778:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a52848a00/0x70647b5fa977419a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790636.615789:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a52848a00/0x70647b5fa977419a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790636.615813:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f052c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253289984:0@lo:101: 00000100:00100000:3.0:1787790636.615943:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790636.616008:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787790636.616275:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253289984 00000100:00100000:1.0:1787790636.616283:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253289984 00000100:00100000:1.0:1787790636.616334:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787790636.616344:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:5843:x1874634253289984:12345-0@lo:101: 00010000:00010000:1.0:1787790636.616366:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790636.616379:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a41479200/0x70647b5fa97741a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa977419a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790636.616404:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a41479200/0x70647b5fa97741a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa977419a expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790636.616415:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a41479200/0x70647b5fa97741a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa977419a expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790636.616424:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41479200, rc 0) 00000100:00100000:1.0:1787790636.616467:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:5843:x1874634253289984:12345-0@lo:101: Request processed in 125us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790636.616475:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787790636.617424:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f052c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253289984:0@lo:101: 00010000:00010000:3.0:1787790636.617447:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a52848a00/0x70647b5fa977419a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97741a1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790636.617458:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a52848a00/0x70647b5fa977419a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97741a1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790636.617525:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f052c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253290112:0@lo:501: 00000100:00100000:3.0:1787790636.617566:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790636.618411:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253290112 00000100:00100000:0.0:1787790636.618418:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253290112 00000100:00100000:0.0:1787790636.618464:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787790636.618472:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45661450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:5843:x1874634253290112:12345-0@lo:501: 00000100:00100000:0.0:1787790636.618986:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45661450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:5843:x1874634253290112:12345-0@lo:501: Request processed in 513us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790636.618994:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787790636.619237:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787790636.619258:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f052c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253290112:0@lo:501: 00000100:00100000:3.0:1787790636.619296:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f052c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253290240:0@lo:503: 00000100:00100000:3.0:1787790636.619334:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790636.619352:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787790636.619379:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253290240 00000100:00100000:3.0:1787790636.619383:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253290240 00000100:00100000:3.0:1787790636.619407:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787790636.619413:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45660c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:5843:x1874634253290240:12345-0@lo:503: 00000100:00100000:3.0:1787790636.620903:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45660c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:5843:x1874634253290240:12345-0@lo:503: Request processed in 1107us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790636.620916:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787790636.621020:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f052c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253290240:0@lo:503: 00000100:00100000:3.0:1787790636.628829:0:7912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f05e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7912:1874634253290368:0@lo:502: 00000100:00100000:3.0:1787790636.628916:0:7912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790636.629017:0:7912:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9c900 going to sleep for 11 seconds 00000100:00100000:0.0:1787790636.632682:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253290368 00000100:00100000:0.0:1787790636.632696:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253290368 00000100:00100000:0.0:1787790636.632803:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787790636.632813:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45661850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:7912:x1874634253290368:12345-0@lo:502: 00000100:00100000:0.0:1787790636.633186:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45661850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:7912:x1874634253290368:12345-0@lo:502: Request processed in 375us (4270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790636.633195:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787790636.633304:0:7912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f05e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7912:1874634253290368:0@lo:502: 00000100:00100000:3.0:1787790636.633382:0:7912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f05e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7912:1874634253290496:0@lo:502: 00000100:00100000:3.0:1787790636.633434:0:7912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790636.641252:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253290496 00000100:00100000:1.0:1787790636.641277:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253290496 00000100:00100000:1.0:1787790636.641339:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787790636.641349:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45660850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:7912:x1874634253290496:12345-0@lo:502: 00000100:00100000:3.0:1787790636.642344:0:7912:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9c900 going to sleep for 11 seconds 00000100:00100000:1.0:1787790636.643867:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45660850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:7912:x1874634253290496:12345-0@lo:502: Request processed in 2513us (10426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790636.643882:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787790636.645760:0:7912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f05e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7912:1874634253290496:0@lo:502: 00000040:00080000:0.0:1787790636.645805:0:7912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787790636.645898:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787790636.645914:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787790636.645993:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a52848a00/0x70647b5fa977419a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97741a1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790636.646004:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a52848a00/0x70647b5fa977419a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97741a1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790636.646014:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787790636.646017:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787790636.646020:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787790636.646437:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97741a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790636.646447:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97741a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790636.646456:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97741a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790636.646477:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253290624:0@lo:101: 00000100:00100000:0.0:1787790636.646548:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790636.647309:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253290624 00000100:00100000:1.0:1787790636.647318:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253290624 00000100:00100000:1.0:1787790636.647380:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787790636.647390:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45661c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:5843:x1874634253290624:12345-0@lo:101: 00010000:00010000:1.0:1787790636.647404:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790636.647419:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a41479800/0x70647b5fa97741af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97741a8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790636.647444:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a41479800/0x70647b5fa97741af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97741a8 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790636.647454:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a41479800/0x70647b5fa97741af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97741a8 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790636.647462:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41479800, rc 0) 00000100:00100000:1.0:1787790636.647509:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45661c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:5843:x1874634253290624:12345-0@lo:101: Request processed in 120us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790636.647515:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787790636.648231:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790636.648258:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253290624:0@lo:101: 00010000:00010000:0.0:1787790636.648274:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97741a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97741af expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790636.648284:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97741a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97741af expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790636.648373:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253290752:0@lo:501: 00000100:00100000:0.0:1787790636.648416:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790636.648447:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e829c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790636.649283:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253290752 00000100:00100000:1.0:1787790636.649291:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253290752 00000100:00100000:1.0:1787790636.649338:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787790636.649348:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45660050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:5843:x1874634253290752:12345-0@lo:501: 00000100:00100000:1.0:1787790636.651287:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45660050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:5843:x1874634253290752:12345-0@lo:501: Request processed in 1934us (2862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790636.651307:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787790636.652223:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253290752:0@lo:501: 00000100:00100000:0.0:1787790636.652285:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253290880:0@lo:503: 00000100:00100000:0.0:1787790636.652345:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790636.652394:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e829c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790636.653273:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253290880 00000100:00100000:1.0:1787790636.653282:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253290880 00000100:00100000:1.0:1787790636.653334:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787790636.653344:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:5843:x1874634253290880:12345-0@lo:503: 00000100:00100000:1.0:1787790636.655973:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:5843:x1874634253290880:12345-0@lo:503: Request processed in 2621us (3619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790636.655987:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787790636.657130:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253290880:0@lo:503: 00000100:00100000:2.0:1787790636.659007:0:7913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db69e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7913:1874634253291008:0@lo:502: 00000100:00100000:2.0:1787790636.659518:0:7913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790636.659569:0:7913:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a42f91000 going to sleep for 11 seconds 00000100:00100000:0.0:1787790636.660794:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253291008 00000100:00100000:0.0:1787790636.660804:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253291008 00000100:00100000:0.0:1787790636.660863:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787790636.660874:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:7913:x1874634253291008:12345-0@lo:502: 00000100:00100000:0.0:1787790636.661425:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:7913:x1874634253291008:12345-0@lo:502: Request processed in 552us (1906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790636.661434:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787790636.661566:0:7913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db69e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7913:1874634253291008:0@lo:502: 00000020:01000000:3.0:1787790636.661751:0:7913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790636.661763:0:7913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790636.661765:0:7913:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787790636.661772:0:7913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787790636.661774:0:7913:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787790636.661806:0:7913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7913:1874634253291136:0@lo:502: 00000100:00100000:3.0:1787790636.661850:0:7913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790636.661882:0:7913:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790636.662014:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253291136 00000100:00100000:0.0:1787790636.662020:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253291136 00000100:00100000:0.0:1787790636.662247:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787790636.662257:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45662050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:7913:x1874634253291136:12345-0@lo:502: 00000100:00100000:0.0:1787790636.662422:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45662050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:7913:x1874634253291136:12345-0@lo:502: Request processed in 166us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790636.662430:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787790636.662748:0:7913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7913:1874634253291136:0@lo:502: 00000020:01000000:3.0:1787790636.662773:0:7913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790636.662778:0:7913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790636.662780:0:7913:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787790636.662785:0:7913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1787790636.663341:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1787790636.663374:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787790636.663385:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97741a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97741af expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790636.663396:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97741a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97741af expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790636.663406:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787790636.663409:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff931a4977d000 from 30 10000000:01000000:2.0:1787790636.663411:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787790636.663442:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97741b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790636.663449:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97741b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790636.663457:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97741b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790636.663473:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db69680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253291264:0@lo:101: 00000100:00100000:2.0:1787790636.663515:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790636.663559:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a42f91600 going to sleep for 11 seconds 00000100:00100000:0.0:1787790636.663691:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253291264 00000100:00100000:0.0:1787790636.663698:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253291264 00000100:00100000:0.0:1787790636.663763:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787790636.663771:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45663050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:5843:x1874634253291264:12345-0@lo:101: 00010000:00010000:0.0:1787790636.663790:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790636.663802:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a40030400/0x70647b5fa97741bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97741b6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790636.663821:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a40030400/0x70647b5fa97741bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97741b6 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790636.663832:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a40030400/0x70647b5fa97741bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97741b6 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790636.663840:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a40030400, rc 0) 00000100:00100000:0.0:1787790636.663879:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45663050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:5843:x1874634253291264:12345-0@lo:101: Request processed in 109us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790636.663885:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787790636.664231:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db69680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253291264:0@lo:101: 00010000:00010000:3.0:1787790636.664247:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97741b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97741bd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790636.664256:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97741b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97741bd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790636.664317:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253291392:0@lo:501: 00000100:00100000:3.0:1787790636.664346:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790636.664383:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790636.664507:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253291392 00000100:00100000:2.0:1787790636.664517:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253291392 00000100:00100000:2.0:1787790636.664565:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787790636.664573:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45663850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:5843:x1874634253291392:12345-0@lo:501: 00000100:00100000:2.0:1787790636.665403:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45663850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:5843:x1874634253291392:12345-0@lo:501: Request processed in 828us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790636.665413:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787790636.674880:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253291392:0@lo:501: 00000100:00100000:3.0:1787790636.674961:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253291520:0@lo:503: 00000100:00100000:3.0:1787790636.675292:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790636.675347:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790636.675416:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253291520 00000100:00100000:1.0:1787790636.675423:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253291520 00000100:00100000:1.0:1787790636.675476:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787790636.675485:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45662850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:5843:x1874634253291520:12345-0@lo:503: 00000100:00100000:1.0:1787790636.675831:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45662850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:5843:x1874634253291520:12345-0@lo:503: Request processed in 345us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790636.675839:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787790636.676290:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253291520:0@lo:503: 00000100:00100000:3.0:1787790636.678290:0:7916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7916:1874634253291648:0@lo:502: 00000100:00100000:3.0:1787790636.678382:0:7916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790636.678429:0:7916:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9c900 going to sleep for 11 seconds 00000100:00100000:1.0:1787790636.678478:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253291648 00000100:00100000:1.0:1787790636.678484:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253291648 00000100:00100000:1.0:1787790636.678543:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787790636.678552:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45661050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:7916:x1874634253291648:12345-0@lo:502: 00000100:00100000:1.0:1787790636.679024:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45661050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:7916:x1874634253291648:12345-0@lo:502: Request processed in 471us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790636.679218:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787790636.679339:0:7916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7916:1874634253291648:0@lo:502: 00000100:00100000:3.0:1787790636.679404:0:7916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7916:1874634253291776:0@lo:502: 00000100:00100000:3.0:1787790636.679443:0:7916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790636.680072:0:7916:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9c900 going to sleep for 11 seconds 00000100:00100000:1.0:1787790636.691764:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253291776 00000100:00100000:1.0:1787790636.691780:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253291776 00000100:00100000:1.0:1787790636.691840:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787790636.691850:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45662450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:7916:x1874634253291776:12345-0@lo:502: 00000100:00100000:1.0:1787790636.692193:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45662450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:7916:x1874634253291776:12345-0@lo:502: Request processed in 343us (12748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790636.692200:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787790636.694867:0:7916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7916:1874634253291776:0@lo:502: 00000040:00080000:2.0:1787790636.694914:0:7916:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787790636.696301:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787790636.696332:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787790636.696344:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97741b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97741bd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790636.696365:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97741b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97741bd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790636.696376:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787790636.696379:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff931a4977d000 from 5 10000000:01000000:1.0:1787790636.696382:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787790636.696444:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa97741c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790636.696453:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa97741c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790636.696464:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa97741c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790636.696487:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253291904:0@lo:101: 00000100:00100000:1.0:1787790636.696568:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790636.696604:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d8159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790636.697686:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253291904 00000100:00100000:2.0:1787790636.697696:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253291904 00000100:00100000:2.0:1787790636.697780:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787790636.697789:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:5843:x1874634253291904:12345-0@lo:101: 00010000:00010000:2.0:1787790636.697806:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790636.697825:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a542f1600/0x70647b5fa97741cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97741c4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790636.697853:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a542f1600/0x70647b5fa97741cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97741c4 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790636.697864:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a542f1600/0x70647b5fa97741cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97741c4 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790636.697872:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f1600, rc 0) 00000100:00100000:2.0:1787790636.698272:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253291904:12345-0@lo:101: Request processed in 483us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790636.698281:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787790636.708082:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253291904:0@lo:101: 00010000:00010000:1.0:1787790636.708115:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa97741c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97741cb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790636.708144:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa97741c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97741cb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790636.708213:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253292032:0@lo:256: 00000100:00100000:1.0:1787790636.708277:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790636.708326:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d8159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790636.708407:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253292032 00000100:00100000:2.0:1787790636.708413:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253292032 00000100:00100000:2.0:1787790636.708469:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787790636.708478:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253292032:12345-0@lo:256: 20000000:01000000:2.0:1787790636.708498:0:5841:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787790636.708513:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787790636.708517:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787790636.708619:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253292032:12345-0@lo:256: Request processed in 142us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790636.708627:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787790636.708704:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253292032:0@lo:256: 10000000:01000000:3.0:1787790636.708779:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787790636.708787:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa97741c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97741cb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790636.708797:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa97741c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97741cb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790636.708805:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787790636.708807:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1787790636.708810:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787790636.708836:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97741d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790636.708854:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97741d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790636.708863:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97741d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790636.708877:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253292160:0@lo:101: 00000100:00100000:3.0:1787790636.708905:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790636.708936:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790636.709100:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253292160 00000100:00100000:2.0:1787790636.709104:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253292160 00000100:00100000:2.0:1787790636.709137:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787790636.709145:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253292160:12345-0@lo:101: 00010000:00010000:2.0:1787790636.709154:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790636.709168:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a542f1e00/0x70647b5fa97741d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97741d2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790636.709187:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a542f1e00/0x70647b5fa97741d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97741d2 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790636.709196:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a542f1e00/0x70647b5fa97741d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97741d2 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790636.709204:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f1e00, rc 0) 00000100:00100000:2.0:1787790636.709232:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253292160:12345-0@lo:101: Request processed in 87us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790636.709237:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787790636.709301:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253292160:0@lo:101: 00010000:00010000:3.0:1787790636.709313:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97741d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97741d9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790636.709321:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97741d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97741d9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790636.709379:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253292288:0@lo:501: 00000100:00100000:3.0:1787790636.709405:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790636.709426:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790636.709593:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253292288 00000100:00100000:2.0:1787790636.709598:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253292288 00000100:00100000:2.0:1787790636.709628:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787790636.709642:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253292288:12345-0@lo:501: 00000100:00100000:2.0:1787790636.709931:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253292288:12345-0@lo:501: Request processed in 275us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790636.709938:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787790636.710168:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253292288:0@lo:501: 00000100:00100000:3.0:1787790636.710202:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253292416:0@lo:503: 00000100:00100000:3.0:1787790636.710243:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790636.710267:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787790636.710406:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253292416 00000100:00100000:1.0:1787790636.710411:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253292416 00000100:00100000:1.0:1787790636.710442:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787790636.710449:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253292416:12345-0@lo:503: 00000100:00100000:1.0:1787790636.710815:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253292416:12345-0@lo:503: Request processed in 365us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790636.710823:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787790636.711369:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253292416:0@lo:503: 00000100:00100000:1.0:1787790636.713645:0:7917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456d8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7917:1874634253292544:0@lo:502: 00000100:00100000:1.0:1787790636.713755:0:7917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790636.713795:0:7917:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b976000 going to sleep for 11 seconds 00000100:00100000:3.0:1787790636.715188:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253292544 00000100:00100000:3.0:1787790636.715208:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253292544 00000100:00100000:3.0:1787790636.715263:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787790636.715273:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:7917:x1874634253292544:12345-0@lo:502: 00000100:00100000:3.0:1787790636.715654:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:7917:x1874634253292544:12345-0@lo:502: Request processed in 381us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790636.715662:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787790636.717156:0:7917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456d8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7917:1874634253292544:0@lo:502: 00000020:01000000:1.0:1787790636.717197:0:7917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787790636.717207:0:7917:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787790636.717215:0:7917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790636.717218:0:7917:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787790636.717223:0:7917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787790636.717227:0:7917:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.125@tcp to nid 0x20000c0a8c97d (192.168.201.125@tcp) 00000020:01000000:1.0:1787790636.717254:0:7917:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787790636.717257:0:7917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787790636.717274:0:7917:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff931a7dc9cd28) 00000020:00000080:1.0:1787790636.717304:0:7917:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787790636.717311:0:7917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787790636.717412:0:7917:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787790636.717418:0:7917:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787790636.717439:0:7917:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70647b5fa97741e7 00010000:00080000:1.0:1787790636.717471:0:7917:0:(ldlm_lib.c:102:import_set_conn()) imp ffff931946410800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.125@tcp at head 00010000:00010000:1.0:1787790636.717714:0:7917:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1787790636.718125:0:7917:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787790636.718138:0:7917:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787790636.718646:0:7917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787790636.718883:0:7917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787790636.718933:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787790636.718998:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787790636.727715:0:7918:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787790636.727749:0:7918:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787790636.751655:0:7917:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787790636.751670:0:7917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787790636.751709:0:7917:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787790636.751754:0:7917:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x70647b5fa97741ee 00000100:00080000:1.0:1787790636.751766:0:7917:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787790636.751772:0:7917:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff931946410800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:1.0:1787790636.751810:0:7917:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931a456d8780 x1874634253292672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787790636.751832:0:7917:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787790636.751884:0:7917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787790636.751889:0:7917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790636.751890:0:7917:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787790636.751893:0:7917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787790636.751897:0:7917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790636.751898:0:7917:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787790636.751901:0:7917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787790636.751909:0:7917:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787790636.752146:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1874634253292672:0@lo:8: 00000100:00100000:2.0:1787790636.752223:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790636.752284:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253292672 00000100:00100000:2.0:1787790636.752290:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253292672 00000100:00100000:2.0:1787790636.752374:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787790636.752380:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3317:x1874634253292672:12345-0@lo:8: 00010000:00080000:2.0:1787790636.752405:0:6685:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:2.0:1787790636.752430:0:6685:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x70647b5fa97741f5 00002000:00100000:2.0:1787790636.752443:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff931a7db5a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113932 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787790636.752447:0:6685:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787790636.752451:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787790636.752594:0:6685:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787790636.752754:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787790636.752779:0:6685:0:(import.c:65:import_set_state_nolock()) ffff931a7db5c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787790636.752828:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1874634253292672:12345-0@lo:8: Request processed in 447us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790636.752835:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787790636.752874:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a456d8780 x1874634253292672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787790646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790636.752884:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787790636.752890:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787790636.752897:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787790636.752909:0:3317:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787790636.752912:0:3317:0:(import.c:65:import_set_state_nolock()) ffff931946410800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787790636.752937:0:3317:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787790636.752942:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1874634253292672:0@lo:8: 00000100:00100000:1.0:1787790636.753578:0:7917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456dad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7917:1874634253292800:0@lo:502: 00000100:00100000:1.0:1787790636.753639:0:7917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790636.753670:0:7917:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b976e40 going to sleep for 11 seconds 00000004:00080000:1.0:1787790636.753705:0:7918:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787790636.753855:0:7918:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 171634130402ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787790636.754174:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253293184:0@lo:400: 00000100:00100000:3.0:1787790636.754211:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790636.754266:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790636.754273:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1874634253293312:0@lo:400: 00000100:00100000:3.0:1787790636.754319:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790636.755391:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253292928:0@lo:400: 00000100:00100000:1.0:1787790636.755440:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790636.755468:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790636.755474:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253293056:0@lo:400: 00000100:00100000:1.0:1787790636.755498:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790636.757222:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253292800 00000100:00100000:2.0:1787790636.757236:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253292800 00000100:00100000:2.0:1787790636.757290:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787790636.757300:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:7917:x1874634253292800:12345-0@lo:502: 00000100:00100000:2.0:1787790636.757597:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:7917:x1874634253292800:12345-0@lo:502: Request processed in 298us (3957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790636.757604:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787790636.760975:0:7917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456dad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:7917:1874634253292800:0@lo:502: 00000020:01000000:1.0:1787790636.761020:0:7917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787790636.761028:0:7917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:0.0:1787790636.763246:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253293184 00000100:00100000:0.0:1787790636.763258:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253293184 00000100:00100000:0.0:1787790636.763316:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787790636.763326:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53f06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253293184:12345-0@lo:400: 00000100:00100000:0.0:1787790636.763434:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53f06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253293184:12345-0@lo:400: Request processed in 109us (9221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790636.763442:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787790636.763474:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253293312 00000100:00100000:0.0:1787790636.763478:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253293312 00000100:00100000:0.0:1787790636.763495:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253292928 00000100:00100000:0.0:1787790636.763497:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253292928 00000100:00100000:0.0:1787790636.763507:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253293056 00000100:00100000:0.0:1787790636.763510:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253293056 00000020:00000080:1.0:1787790636.764784:0:7917:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787790636.764794:0:7917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1787790636.766012:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00000100:00100000:0.0:1787790636.766147:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787790636.766475:0:5848:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787790636.766486:0:5848:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787790636.766512:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787790636.768205:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787790636.768226:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253292928:12345-0@lo:400: 00000100:00100000:0.0:1787790636.768333:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253292928:12345-0@lo:400: Request processed in 116us (12892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790636.768340:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787790636.768376:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787790636.768385:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787790636.768392:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253293056:12345-0@lo:400: 00000100:00100000:0.0:1787790636.768421:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253293056:12345-0@lo:400: Request processed in 30us (12922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790636.768427:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787790636.770611:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a53f052c0 x1874634253293184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790636.770631:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253293184:0@lo:400: 10000000:01000000:3.0:1787790636.770847:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787790636.770860:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97741d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97741d9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790636.770871:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97741d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97741d9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790636.770883:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787790636.770886:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff931a44ec4d28 from 1 10000000:01000000:3.0:1787790636.770888:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787790636.770922:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a52848c00/0x70647b5fa97741fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790636.770930:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a52848c00/0x70647b5fa97741fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790636.770940:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a52848c00/0x70647b5fa97741fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790636.770970:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253293440:0@lo:101: 00000100:00100000:3.0:1787790636.771046:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790636.771087:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790636.771434:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253293440 00000100:00100000:1.0:1787790636.771441:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253293440 00000100:00100000:1.0:1787790636.771491:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787790636.771501:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253293440:12345-0@lo:101: 00010000:00010000:1.0:1787790636.771517:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790636.771530:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a41479e00/0x70647b5fa9774203 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97741fc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790636.771552:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a41479e00/0x70647b5fa9774203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97741fc expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790636.771563:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a41479e00/0x70647b5fa9774203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97741fc expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790636.771583:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41479e00, rc 0) 00000100:00100000:1.0:1787790636.771629:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:5843:x1874634253293440:12345-0@lo:101: Request processed in 129us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790636.771635:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787790636.771676:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f05680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253293440:0@lo:101: 00010000:00010000:1.0:1787790636.771689:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a52848c00/0x70647b5fa97741fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774203 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790636.771698:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a52848c00/0x70647b5fa97741fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9774203 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790636.771777:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456dad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253293568:0@lo:501: 00000100:00100000:1.0:1787790636.771805:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790636.771829:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253293568 00000100:00100000:1.0:1787790636.771833:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253293568 00000100:00100000:1.0:1787790636.771856:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787790636.771863:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:5843:x1874634253293568:12345-0@lo:501: 00000100:00100000:1.0:1787790636.772071:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:5843:x1874634253293568:12345-0@lo:501: Request processed in 208us (265us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787790636.772078:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787790636.772109:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b976c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787790636.772121:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456dad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253293568:0@lo:501: 10000000:01000000:1.0:1787790636.772144:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787790636.772150:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a52848c00/0x70647b5fa97741fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774203 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790636.772179:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a52848c00/0x70647b5fa97741fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774203 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1787790636.775301:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a53f05e00 x1874634253293056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790636.775322:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253293056:0@lo:400: 00010000:00080000:0.0:1787790636.775338:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a53f070c0 x1874634253292928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790636.775348:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253292928:0@lo:400: 00000100:00100000:0.0:1787790636.775405:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53f07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874634253293312:12345-0@lo:400: 00000100:00100000:0.0:1787790636.775493:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53f07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874634253293312:12345-0@lo:400: Request processed in 9335us (21172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790636.775504:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787790636.775556:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a53f061c0 x1874634253293312/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790636.775568:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1874634253293312:0@lo:400: 00010000:00010000:1.0:1787790636.804546:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787790636.853635:0:7919:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787790636.853668:0:7919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db6a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7919:1874634253293824:0@lo:7: 00000100:00100000:2.0:1787790636.853759:0:7919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787790636.853804:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787790636.853810:0:7919:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a42f91600 going to sleep for 11 seconds 00000100:00100000:1.0:1787790636.857224:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787790636.857254:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253293696:0@lo:13: 00000100:00100000:1.0:1787790636.857334:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790636.857481:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253293696 00000100:00100000:2.0:1787790636.857489:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253293696 00000100:00100000:2.0:1787790636.857564:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787790636.857574:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1874634253293696:12345-0@lo:13: 00000100:00080000:3.0:1787790636.857593:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1787790636.857612:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787790636.857667:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1874634253293696:12345-0@lo:13: Request processed in 96us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790636.857675:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787790636.857775:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7db6ad00 x1874634253293696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790652 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790636.857796:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253293696:0@lo:13: 00000100:00100000:0.0:1787790636.859062:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253293824 00000100:00100000:0.0:1787790636.859072:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253293824 00000100:00100000:0.0:1787790636.859123:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787790636.859133:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7919:x1874634253293824:12345-0@lo:7: 00002000:00080000:0.0:1787790636.876881:0:6683:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787790636.876890:0:6683:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787790636.877566:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7919:x1874634253293824:12345-0@lo:7: Request processed in 18430us (23802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790636.877579:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787790636.877797:0:7919:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7db6a1c0 x1874634253293824/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787790652 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790636.877815:0:7919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db6a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7919:1874634253293824:0@lo:7: 00000004:00080000:3.0:1787790636.877832:0:7919:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787790636.877874:0:7919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f061c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7919:1874634253293952:0@lo:5: 00000100:00100000:3.0:1787790636.877924:0:7919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790636.877969:0:7919:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790636.878442:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253293952 00000100:00100000:0.0:1787790636.878449:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253293952 00000100:00100000:0.0:1787790636.878501:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787790636.878510:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53f070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7919:x1874634253293952:12345-0@lo:5: 00002000:00080000:0.0:1787790636.878536:0:6685:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787790636.878540:0:6685:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787790636.878869:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53f070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7919:x1874634253293952:12345-0@lo:5: Request processed in 359us (943us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787790636.878876:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787790636.878932:0:7919:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a53f061c0 x1874634253293952/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787790652 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790636.878948:0:7919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f061c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7919:1874634253293952:0@lo:5: 00000004:00080000:0.0:1787790636.878961:0:7919:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787790636.878991:0:7919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7919:1874634253294080:0@lo:700: 00000100:00100000:0.0:1787790636.879035:0:7919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790636.879064:0:7919:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e823c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790636.879091:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253294080 00000100:00100000:3.0:1787790636.879096:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253294080 00000100:00100000:3.0:1787790636.879181:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790636.879189:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ee92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7919:x1874634253294080:12345-0@lo:700: 00000100:00100000:3.0:1787790636.879217:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f05e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6692:1874634253294208:0@lo:700: 00000100:00100000:3.0:1787790636.879245:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790636.879259:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790636.879417:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253294208 00000100:00100000:0.0:1787790636.879422:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253294208 00000100:00100000:0.0:1787790636.879459:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787790636.879467:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53f05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6692:x1874634253294208:12345-0@lo:700: 40000000:02000000:0.0:1787790636.994662:0:5853:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1787790637.003447:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53f05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6692:x1874634253294208:12345-0@lo:700: Request processed in 123972us (124191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790637.003463:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787790637.003489:0:6692:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a53f05e00 x1874634253294208/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787790652 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790637.003528:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f05e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6692:1874634253294208:0@lo:700: 40000000:02000000:3.0:1787790637.003543:0:6692:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:1.0:1787790637.123766:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1787790637.123787:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787790637.124169:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ee92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7919:x1874634253294080:12345-0@lo:700: Request processed in 244976us (245128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790637.124183:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787790637.124992:0:7919:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a53ee8000 x1874634253294080/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787790652 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790637.125006:0:7919:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787790637.125026:0:7919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7919:1874634253294080:0@lo:700: 00000004:02000040:1.0:1787790637.190211:0:7919:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1787790637.194977:0:7919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456db840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7919:1874634253294336:0@lo:5: 00000100:00100000:1.0:1787790637.195057:0:7919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790637.195130:0:7919:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a48c0b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790637.195214:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253294336 00000100:00100000:0.0:1787790637.195221:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253294336 00000100:00100000:0.0:1787790637.195273:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787790637.195283:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7919:x1874634253294336:12345-0@lo:5: 00002000:00080000:0.0:1787790637.202666:0:6683:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787790637.202687:0:6683:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1787790637.206323:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7919:x1874634253294336:12345-0@lo:5: Request processed in 11034us (11258us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787790637.206338:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787790637.206607:0:7919:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a456db840 x1874634253294336/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787790653 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790637.206625:0:7919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456db840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7919:1874634253294336:0@lo:5: 00000004:00080000:1.0:1787790637.206642:0:7919:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:2.0:1787790637.578323:0:7979:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787790637.824977:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790638.848045:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790639.872483:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790640.897622:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790641.216216:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787790641.218309:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253294464:0@lo:13: 00000100:00100000:0.0:1787790641.218391:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790641.224415:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253294464 00000100:00100000:2.0:1787790641.224432:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253294464 00000100:00080000:3.0:1787790641.224950:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790641.226360:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787790641.226380:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53eea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253294464:12345-0@lo:13: 00002000:00000024:0.0:1787790641.226420:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787790641.226550:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53eea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253294464:12345-0@lo:13: Request processed in 177us (8157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790641.226558:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787790641.226652:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a456d8000 x1874634253294464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790657 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790641.226681:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253294464:0@lo:13: 00010000:00010000:1.0:1787790641.921164:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790642.241343:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253294592:0@lo:400: 00000100:00100000:0.0:1787790642.241418:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790642.241486:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1874634253295104:0@lo:400: 00000100:00100000:1.0:1787790642.243349:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253294592 00000100:00100000:1.0:1787790642.243360:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253294592 00000100:00100000:1.0:1787790642.243419:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787790642.243442:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3320:x1874634253294592:12345-0@lo:400: 00000100:00100000:1.0:1787790642.243529:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3320:x1874634253294592:12345-0@lo:400: Request processed in 102us (2110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790642.243537:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787790642.243787:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253294848:0@lo:400: 00000100:00100000:1.0:1787790642.243823:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790642.243851:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253295360:0@lo:13: 00000100:00100000:1.0:1787790642.243877:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790642.243902:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790642.243909:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253294976:0@lo:400: 00000100:00100000:1.0:1787790642.243934:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790642.243962:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253294720:0@lo:400: 00000100:00100000:0.0:1787790642.245135:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790642.245190:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253294592:0@lo:400: 00000100:00100000:0.0:1787790642.245230:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253294848 00000100:00100000:0.0:1787790642.245236:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253294848 00000100:00100000:0.0:1787790642.245292:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253295104 00000100:00100000:0.0:1787790642.245296:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253295104 00000100:00100000:0.0:1787790642.245317:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787790642.245324:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253294848:12345-0@lo:400: 00000100:00100000:0.0:1787790642.245372:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253294848:12345-0@lo:400: Request processed in 48us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790642.245379:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787790642.245393:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787790642.245400:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874634253295104:12345-0@lo:400: 00000100:00100000:0.0:1787790642.245432:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874634253295104:12345-0@lo:400: Request processed in 32us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790642.245438:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1787790642.245456:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787790642.245483:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7befcf00 x1874634253294848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790642.245495:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253294848:0@lo:400: 00010000:00080000:0.0:1787790642.245536:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7beff480 x1874634253295104/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790642.245544:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1874634253295104:0@lo:400: 00000100:00100000:0.0:1787790642.245575:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253295360 00000100:00100000:0.0:1787790642.245578:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253295360 00000100:00100000:0.0:1787790642.245607:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787790642.245614:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1874634253295360:12345-0@lo:13: 00002000:00000024:0.0:1787790642.245644:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787790642.245682:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1874634253295360:12345-0@lo:13: Request processed in 68us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790642.245688:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787790642.245702:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787790642.245742:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a456d8f00 x1874634253295360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790642.245760:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253295360:0@lo:13: 00000100:00100000:3.0:1787790642.247233:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253294976 00000100:00100000:3.0:1787790642.247244:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253294976 00000100:00100000:3.0:1787790642.247399:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787790642.247409:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253294976:12345-0@lo:400: 00000100:00100000:3.0:1787790642.247473:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253294976:12345-0@lo:400: Request processed in 66us (3537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790642.247479:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787790642.248256:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7befd2c0 x1874634253294976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790642.248279:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253294976:0@lo:400: 00000100:00100000:1.0:1787790642.249290:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790642.249331:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253295232:0@lo:400: 00000100:00100000:1.0:1787790642.249360:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790642.249399:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253294720 00000100:00100000:1.0:1787790642.249405:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253294720 00000100:00100000:1.0:1787790642.249451:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787790642.249460:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253294720:12345-0@lo:400: 00000100:00100000:1.0:1787790642.251149:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253294720:12345-0@lo:400: Request processed in 1682us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790642.251163:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787790642.251204:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253295232 00000100:00100000:1.0:1787790642.251209:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253295232 00000100:00100000:1.0:1787790642.251256:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787790642.254000:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3321:x1874634253295232:12345-0@lo:400: 00000100:00100000:1.0:1787790642.254100:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3321:x1874634253295232:12345-0@lo:400: Request processed in 2837us (4737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790642.254109:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787790642.257364:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a53ee8780 x1874634253294720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790642.257383:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253294720:0@lo:400: 00010000:00080000:1.0:1787790642.257398:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7befe940 x1874634253295232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790642.257409:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253295232:0@lo:400: 00000001:00080000:1.0:1787790642.339831:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1787790642.947327:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790643.968144:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790644.781409:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790644.781495:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236494208 00000100:00100000:1.0:1787790644.781505:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236494208 00000100:00100000:1.0:1787790644.781546:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 112 00000100:00100000:1.0:1787790644.781553:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2345:x1874634236494208:12345-192.168.201.25@tcp:250: 00010000:00080000:1.0:1787790644.781579:0:5838:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b956aedb-a574-46fa-b700-b912aca9a68a@192.168.201.25@tcp t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:1.0:1787790644.781603:0:5838:0:(genops.c:1385:class_connect()) connect: client b956aedb-a574-46fa-b700-b912aca9a68a, cookie 0x70647b5fa977420a 00000100:00080000:1.0:1787790644.781758:0:5838:0:(import.c:65:import_set_state_nolock()) ffff931946412800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787790644.781839:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+5:2345:x1874634236494208:12345-192.168.201.25@tcp:250: Request processed in 286us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790644.781845:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 112 00000100:00100000:0.0:1787790644.786851:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790644.787409:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236494080 00000100:00100000:1.0:1787790644.787421:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236494080 00000100:00100000:1.0:1787790644.787537:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 113 00000100:00100000:1.0:1787790644.787545:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+5:5571:x1874634236494080:12345-192.168.201.25@tcp:101: 00010000:00010000:1.0:1787790644.787572:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790644.787587:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a45704a00/0x70647b5fa9774211 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496e925 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790644.787618:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a45704a00/0x70647b5fa9774211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e925 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790644.787628:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a45704a00/0x70647b5fa9774211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e925 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790644.787638:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45704a00, rc 0) 00000100:00100000:1.0:1787790644.787695:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+6:5571:x1874634236494080:12345-192.168.201.25@tcp:101: Request processed in 151us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790644.787700:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 113 00000100:00100000:0.0:1787790644.793430:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790644.793604:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236494336 00000100:00100000:2.0:1787790644.793615:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236494336 00000100:00100000:2.0:1787790644.793680:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 114 00000100:00100000:2.0:1787790644.793690:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+6:5571:x1874634236494336:12345-192.168.201.25@tcp:501: 00000100:00100000:2.0:1787790644.794242:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+6:5571:x1874634236494336:12345-192.168.201.25@tcp:501: Request processed in 553us (821us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787790644.794251:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 114 00000100:00100000:0.0:1787790644.803805:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790644.803875:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236494464 00000100:00100000:1.0:1787790644.803886:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236494464 00000100:00100000:1.0:1787790644.803945:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 115 00000100:00100000:1.0:1787790644.803955:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+6:5571:x1874634236494464:12345-192.168.201.25@tcp:101: 00010000:00010000:1.0:1787790644.803971:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790644.803987:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a45705e00/0x70647b5fa9774218 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496e92c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790644.804017:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a45705e00/0x70647b5fa9774218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e92c expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790644.804028:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a45705e00/0x70647b5fa9774218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e92c expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790644.804037:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45705e00, rc 0) 00000100:00100000:1.0:1787790644.804115:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+7:5571:x1874634236494464:12345-192.168.201.25@tcp:101: Request processed in 160us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790644.804122:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 115 00000100:00100000:0.0:1787790644.807011:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790644.807077:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236494592 00000100:00100000:1.0:1787790644.807087:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236494592 00000100:00100000:1.0:1787790644.807143:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 116 00000100:00100000:1.0:1787790644.807153:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+7:5571:x1874634236494592:12345-192.168.201.25@tcp:501: 00000100:00100000:1.0:1787790644.807501:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+8:5571:x1874634236494592:12345-192.168.201.25@tcp:501: Request processed in 348us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790644.807510:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 116 00000100:00100000:0.0:1787790644.811080:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790644.811293:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236494720 00000100:00100000:1.0:1787790644.811307:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236494720 00000100:00100000:1.0:1787790644.811364:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 117 00000100:00100000:1.0:1787790644.811374:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+8:5571:x1874634236494720:12345-192.168.201.25@tcp:503: 00000100:00100000:1.0:1787790644.812172:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+8:5571:x1874634236494720:12345-192.168.201.25@tcp:503: Request processed in 795us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790644.812181:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 117 00000100:00100000:0.0:1787790644.818922:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790644.819052:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236494848 00000100:00100000:1.0:1787790644.819066:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236494848 00000100:00100000:1.0:1787790644.819139:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 118 00000100:00100000:1.0:1787790644.819151:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+8:5589:x1874634236494848:12345-192.168.201.25@tcp:502: 00000100:00100000:1.0:1787790644.819603:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+8:5589:x1874634236494848:12345-192.168.201.25@tcp:502: Request processed in 453us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790644.819613:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 118 00000100:00100000:0.0:1787790644.866770:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790644.866971:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236494976 00000100:00100000:2.0:1787790644.866981:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236494976 00000100:00100000:2.0:1787790644.867041:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 119 00000100:00100000:2.0:1787790644.867052:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+8:5589:x1874634236494976:12345-192.168.201.25@tcp:502: 00000100:00100000:2.0:1787790644.867838:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+8:5589:x1874634236494976:12345-192.168.201.25@tcp:502: Request processed in 784us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790644.867847:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 119 00000100:00100000:0.0:1787790644.880305:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790644.880395:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236495104 00000100:00100000:1.0:1787790644.880403:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236495104 00000100:00100000:1.0:1787790644.880483:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 120 00000100:00100000:1.0:1787790644.880492:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+8:5571:x1874634236495104:12345-192.168.201.25@tcp:101: 00010000:00010000:1.0:1787790644.880509:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790644.880528:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a45704800/0x70647b5fa977421f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496e956 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790644.880553:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a45704800/0x70647b5fa977421f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e956 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790644.880561:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a45704800/0x70647b5fa977421f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e956 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790644.880568:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45704800, rc 0) 00000100:00100000:1.0:1787790644.880627:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+9:5571:x1874634236495104:12345-192.168.201.25@tcp:101: Request processed in 137us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790644.880635:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 120 00000100:00100000:1.0:1787790644.882948:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790644.883095:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236495232 00000100:00100000:2.0:1787790644.883102:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236495232 00000100:00100000:2.0:1787790644.883140:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 121 00000100:00100000:2.0:1787790644.883147:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+9:5571:x1874634236495232:12345-192.168.201.25@tcp:256: 20000000:01000000:2.0:1787790644.883164:0:5841:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787790644.883184:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787790644.883186:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787790644.883188:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787790644.883190:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787790644.886638:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+9:5571:x1874634236495232:12345-192.168.201.25@tcp:256: Request processed in 3479us (3687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790644.886662:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 121 00000100:00100000:0.0:1787790644.893434:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790644.894244:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236495360 00000100:00100000:2.0:1787790644.894255:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236495360 00000100:00100000:2.0:1787790644.894322:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 122 00000100:00100000:2.0:1787790644.894331:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+9:5571:x1874634236495360:12345-192.168.201.25@tcp:101: 00010000:00010000:2.0:1787790644.894350:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790644.894370:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a542f1200/0x70647b5fa9774226 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496e95d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790644.894415:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a542f1200/0x70647b5fa9774226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e95d expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790644.894426:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a542f1200/0x70647b5fa9774226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e95d expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790644.894435:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f1200, rc 0) 00000100:00100000:2.0:1787790644.894507:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+10:5571:x1874634236495360:12345-192.168.201.25@tcp:101: Request processed in 177us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790644.894515:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 122 00000100:00100000:1.0:1787790644.905110:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790644.905323:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236495488 00000100:00100000:2.0:1787790644.905333:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236495488 00000100:00100000:2.0:1787790644.905434:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 123 00000100:00100000:2.0:1787790644.905444:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+10:5571:x1874634236495488:12345-192.168.201.25@tcp:501: 00000100:00100000:2.0:1787790644.905781:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+10:5571:x1874634236495488:12345-192.168.201.25@tcp:501: Request processed in 337us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790644.905789:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 123 00000100:00100000:0.0:1787790644.908952:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790644.912408:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236495616 00000100:00100000:1.0:1787790644.912428:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236495616 00000100:00100000:1.0:1787790644.912504:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 124 00000100:00100000:1.0:1787790644.912514:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+10:5571:x1874634236495616:12345-192.168.201.25@tcp:503: 00000100:00100000:1.0:1787790644.912971:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+10:5571:x1874634236495616:12345-192.168.201.25@tcp:503: Request processed in 457us (4024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790644.912981:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 124 00000100:00100000:0.0:1787790644.919504:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790644.919817:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236495744 00000100:00100000:1.0:1787790644.919827:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236495744 00000100:00100000:1.0:1787790644.919881:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 125 00000100:00100000:1.0:1787790644.919907:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+10:5593:x1874634236495744:12345-192.168.201.25@tcp:502: 00000100:00100000:1.0:1787790644.920447:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+10:5593:x1874634236495744:12345-192.168.201.25@tcp:502: Request processed in 540us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790644.920456:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 125 00000100:00100000:0.0:1787790644.922480:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790644.922591:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236495872 00000100:00100000:3.0:1787790644.922652:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236495872 00000100:00100000:3.0:1787790644.922831:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 126 00000100:00100000:3.0:1787790644.922842:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+10:5593:x1874634236495872:12345-192.168.201.25@tcp:502: 00000100:00100000:3.0:1787790644.923066:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+10:5593:x1874634236495872:12345-192.168.201.25@tcp:502: Request processed in 225us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790644.923073:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 126 00000100:00100000:0.0:1787790644.926143:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790644.926280:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236496000 00000100:00100000:2.0:1787790644.926302:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236496000 00000100:00100000:2.0:1787790644.926388:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:2.0:1787790644.926395:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2345:x1874634236496000:12345-192.168.201.25@tcp:38: 00010000:00080000:2.0:1787790644.926425:0:5848:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:2.0:1787790644.926474:0:5848:0:(genops.c:1385:class_connect()) connect: client 3e6e059d-f39a-42a8-9e93-fd30a950cc49, cookie 0x70647b5fa977422d 00000004:00100000:2.0:1787790644.926505:0:5848:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787790644.926513:0:5848:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787790644.961382:0:5848:0:(import.c:65:import_set_state_nolock()) ffff931a7b876000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787790644.961584:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2345:x1874634236496000:12345-192.168.201.25@tcp:38: Request processed in 35185us (35447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790644.961662:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00010000:00010000:1.0:1787790644.993750:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790645.986243:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790645.986287:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790645.986568:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236496256 00000100:00100000:2.0:1787790645.986588:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236496256 00000100:00100000:2.0:1787790645.986661:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236496128 00000100:00100000:2.0:1787790645.986665:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236496128 00000100:00100000:2.0:1787790645.986690:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:2.0:1787790645.986700:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:5571:x1874634236496256:12345-192.168.201.25@tcp:41: 00000004:00000024:2.0:1787790645.986787:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787790645.986896:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:5571:x1874634236496256:12345-192.168.201.25@tcp:41: Request processed in 196us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790645.986904:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:2.0:1787790645.986923:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:2.0:1787790645.986930:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:0:x1874634236496128:12345-192.168.201.25@tcp:41: 00000004:00000024:2.0:1787790645.986941:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787790645.986962:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:0:x1874634236496128:12345-192.168.201.25@tcp:41: Request processed in 34us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790645.986985:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00080000:0.0:1787790645.987271:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790645.990271:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790645.990527:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236496384 00000100:00100000:2.0:1787790645.990541:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236496384 00000100:00100000:2.0:1787790645.990623:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:2.0:1787790645.990635:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:5571:x1874634236496384:12345-192.168.201.25@tcp:40: 00000100:00100000:2.0:1787790645.990873:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:5571:x1874634236496384:12345-192.168.201.25@tcp:40: Request processed in 239us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790645.990882:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:0.0:1787790645.997712:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790645.997861:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236496768 00000100:00100000:3.0:1787790645.997874:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236496768 00000100:00100000:3.0:1787790645.997950:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:3.0:1787790645.997962:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:5571:x1874634236496768:12345-192.168.201.25@tcp:33: 00000100:00100000:0.0:1787790645.998696:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790645.998843:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236496896 00000100:00100000:1.0:1787790645.998851:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236496896 00000100:00100000:1.0:1787790645.998896:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 127 00000100:00100000:1.0:1787790645.998906:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+10:2349:x1874634236496896:12345-192.168.201.25@tcp:400: 00000100:00100000:1.0:1787790645.998984:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+10:2349:x1874634236496896:12345-192.168.201.25@tcp:400: Request processed in 79us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790645.999008:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 127 00000100:00100000:0.0:1787790646.003103:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790646.003240:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790646.003304:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236496512 00000100:00100000:0.0:1787790646.003317:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236496512 00000100:00100000:0.0:1787790646.003366:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236496640 00000100:00100000:0.0:1787790646.003370:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236496640 00000100:00100000:0.0:1787790646.003388:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:0.0:1787790646.003398:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1874634236496512:12345-192.168.201.25@tcp:8: 00010000:00080000:0.0:1787790646.003439:0:6684:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:0.0:1787790646.003480:0:6684:0:(genops.c:1385:class_connect()) connect: client 3e6e059d-f39a-42a8-9e93-fd30a950cc49, cookie 0x70647b5fa9774234 00002000:00100000:0.0:1787790646.003496:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3e6e059d-f39a-42a8-9e93-fd30a950cc49/ffff931946458800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787790646.003526:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787790646.007323:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787790646.007383:0:6684:0:(import.c:65:import_set_state_nolock()) ffff93194645a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787790646.009417:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2345:x1874634236496512:12345-192.168.201.25@tcp:8: Request processed in 6010us (10651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790646.009434:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:0.0:1787790646.009486:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:0.0:1787790646.009492:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1874634236496640:12345-192.168.201.25@tcp:8: 00010000:00080000:0.0:1787790646.009532:0:6684:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:0.0:1787790646.009569:0:6684:0:(genops.c:1385:class_connect()) connect: client 3e6e059d-f39a-42a8-9e93-fd30a950cc49, cookie 0x70647b5fa977423b 00002000:00100000:0.0:1787790646.009584:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3e6e059d-f39a-42a8-9e93-fd30a950cc49/ffff93194645c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787790646.009611:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787790646.009937:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787790646.009973:0:6684:0:(import.c:65:import_set_state_nolock()) ffff93194645f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787790646.010022:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2345:x1874634236496640:12345-192.168.201.25@tcp:8: Request processed in 529us (6783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790646.010027:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00010000:00010000:1.0:1787790646.038696:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787790646.045639:0:5849:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 47423us 00000004:00200000:1.0:1787790646.068166:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787790646.068402:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:5571:x1874634236496768:12345-192.168.201.25@tcp:33: Request processed in 70434us (70696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790646.068422:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:0.0:1787790646.338112:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253295488:0@lo:13: 00000100:00100000:0.0:1787790646.338224:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790646.338826:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253295488 00000100:00100000:1.0:1787790646.338839:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253295488 00000100:00100000:1.0:1787790646.338978:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787790646.338993:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253295488:12345-0@lo:13: 00002000:00000024:1.0:1787790646.339029:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787790646.339108:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253295488:12345-0@lo:13: Request processed in 119us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790646.339117:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787790646.339178:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787790646.339248:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a45dbe1c0 x1874634253295488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790662 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790646.339269:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253295488:0@lo:13: 00000100:00100000:0.0:1787790646.367572:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790646.367667:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236497024 00000100:00100000:3.0:1787790646.367681:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236497024 00000100:00100000:3.0:1787790646.367782:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:3.0:1787790646.367794:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:5611:x1874634236497024:12345-192.168.201.25@tcp:101: 00010000:00010000:3.0:1787790646.367825:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790646.369499:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a52848400/0x70647b5fa9774242 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496e987 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790646.369590:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a52849200/0x70647b5fa9774249 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790646.369618:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a52849200/0x70647b5fa9774249 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790646.369635:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a52849200/0x70647b5fa9774249 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790646.371104:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787790646.371243:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787790646.371346:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a52849200/0x70647b5fa9774249 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790646.371398:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a52848400/0x70647b5fa9774242 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e987 expref: 8 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790646.371418:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a52849200/0x70647b5fa9774249 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e987 expref: 7 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790646.371441:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a541adf00) 00010000:00010000:3.0:1787790646.371444:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787790646.371447:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a52849200, rc 0) 00000100:00100000:3.0:1787790646.371522:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:5611:x1874634236497024:12345-192.168.201.25@tcp:101: Request processed in 3730us (3965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790646.371530:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00010000:00010000:1.0:1787790647.039997:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790647.360353:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253295616:0@lo:13: 00000100:00100000:0.0:1787790647.360456:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790647.360593:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253295616 00000100:00100000:1.0:1787790647.360619:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253295616 00000100:00100000:1.0:1787790647.360695:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787790647.360706:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253295616:12345-0@lo:13: 00002000:00000024:1.0:1787790647.360773:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787790647.360880:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253295744:0@lo:400: 00000100:00100000:2.0:1787790647.360924:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790647.360976:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253295744 00000100:00100000:2.0:1787790647.360980:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253295744 00000100:00100000:2.0:1787790647.361011:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787790647.361018:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3321:x1874634253295744:12345-0@lo:400: 00000100:00100000:2.0:1787790647.361059:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3321:x1874634253295744:12345-0@lo:400: Request processed in 40us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790647.361067:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787790647.361121:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253295744:0@lo:400: 00000100:00080000:2.0:1787790647.361696:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787790647.362310:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253295872:0@lo:400: 00000100:00100000:2.0:1787790647.362364:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790647.362508:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787790647.362516:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253296000:0@lo:400: 00000100:00100000:2.0:1787790647.362549:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790647.362588:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253295872 00000100:00100000:2.0:1787790647.362606:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253295872 00000100:00100000:2.0:1787790647.362648:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253296000 00000100:00100000:2.0:1787790647.362651:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253296000 00000100:00100000:2.0:1787790647.362684:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787790647.362692:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253295872:12345-0@lo:400: 00000100:00100000:2.0:1787790647.362759:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253295872:12345-0@lo:400: Request processed in 68us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790647.362766:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787790647.362783:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787790647.362789:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253296000:12345-0@lo:400: 00000100:00100000:2.0:1787790647.362815:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253296000:12345-0@lo:400: Request processed in 27us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790647.362822:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1787790647.362841:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790647.362871:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253296000:0@lo:400: 00000100:00100000:2.0:1787790647.362883:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253295872:0@lo:400: 00000100:00100000:2.0:1787790647.363208:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787790647.363277:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253295616:12345-0@lo:13: Request processed in 2571us (2818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790647.363287:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787790647.363599:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a45dbc780 x1874634253295616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790647.363624:0:3320:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787790647.363649:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253295616:0@lo:13: 00000100:00100000:0.0:1787790647.363663:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790647.363670:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1874634253296256:0@lo:400: 00000100:00100000:0.0:1787790647.363705:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790647.363915:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253296256 00000100:00100000:1.0:1787790647.363921:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253296256 00000100:00100000:1.0:1787790647.363972:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787790647.363979:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874634253296256:12345-0@lo:400: 00000100:00100000:1.0:1787790647.364020:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874634253296256:12345-0@lo:400: Request processed in 41us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790647.364026:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1787790647.364098:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790647.364242:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1874634253296256:0@lo:400: 00000100:00100000:2.0:1787790647.364423:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253296128:0@lo:400: 00000100:00100000:2.0:1787790647.364461:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790647.365178:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253296128 00000100:00100000:1.0:1787790647.365186:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253296128 00000100:00100000:1.0:1787790647.365270:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787790647.365280:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253296128:12345-0@lo:400: 00000100:00100000:1.0:1787790647.365342:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253296128:12345-0@lo:400: Request processed in 64us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790647.365348:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787790647.365410:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a53f061c0 x1874634253296128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790647.365423:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253296128:0@lo:400: 00010000:00010000:1.0:1787790648.064074:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790648.574881:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790648.575084:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236497152 00000100:00100000:2.0:1787790648.575266:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236497152 00000100:00080000:0.0:1787790648.575426:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790648.575479:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:2.0:1787790648.575493:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:5663:x1874634236497152:12345-192.168.201.25@tcp:41: 00000004:00000024:2.0:1787790648.575571:0:7920:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787790648.575657:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:5663:x1874634236497152:12345-192.168.201.25@tcp:41: Request processed in 168us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790648.575665:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:1.0:1787790648.588687:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790648.588842:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236497280 00000100:00100000:2.0:1787790648.588856:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236497280 00000100:00100000:2.0:1787790648.588954:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:2.0:1787790648.588967:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:5663:x1874634236497280:12345-192.168.201.25@tcp:13: 00002000:00000024:2.0:1787790648.589019:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787790648.589248:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790648.589428:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:5663:x1874634236497280:12345-192.168.201.25@tcp:13: Request processed in 463us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790648.589438:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:0.0:1787790648.602196:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790648.602627:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236497408 00000100:00100000:1.0:1787790648.602640:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236497408 00000100:00100000:1.0:1787790648.602773:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00080000:0.0:1787790648.602818:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790648.603044:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:5663:x1874634236497408:12345-192.168.201.25@tcp:13: 00002000:00000024:1.0:1787790648.603098:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787790648.603201:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:5663:x1874634236497408:12345-192.168.201.25@tcp:13: Request processed in 162us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790648.608283:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00010000:00010000:0.0:1787790649.088618:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787790649.446024:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3e6e059d-f39a-42a8-9e93-fd30a950cc49 00010000:00010000:0.0:1787790650.132641:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787790650.471500:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3e6e059d-f39a-42a8-9e93-fd30a950cc49 00000001:00100000:3.0:1787790650.981038:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3e6e059d-f39a-42a8-9e93-fd30a950cc49 00010000:00010000:0.0:1787790651.139139:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790651.308554:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790651.308603:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790651.308634:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790651.308661:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790651.308698:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236497664 00000100:00100000:0.0:1787790651.308709:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236497664 00000100:00100000:0.0:1787790651.308791:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:0.0:1787790651.308802:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2349:x1874634236497664:12345-192.168.201.25@tcp:400: 00000100:00100000:0.0:1787790651.308873:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2349:x1874634236497664:12345-192.168.201.25@tcp:400: Request processed in 74us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790651.308881:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00080000:0.0:1787790651.308902:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790651.309325:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236497792 00000100:00100000:3.0:1787790651.309331:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236497792 00000100:00100000:3.0:1787790651.309363:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236497920 00000100:00100000:3.0:1787790651.309367:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236497920 00000100:00100000:3.0:1787790651.309383:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:3.0:1787790651.309389:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2349:x1874634236497792:12345-192.168.201.25@tcp:400: 00000100:00100000:3.0:1787790651.309424:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2349:x1874634236497792:12345-192.168.201.25@tcp:400: Request processed in 36us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790651.309429:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:3.0:1787790651.309444:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:3.0:1787790651.309450:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2349:x1874634236497920:12345-192.168.201.25@tcp:400: 00000100:00100000:3.0:1787790651.309473:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2349:x1874634236497920:12345-192.168.201.25@tcp:400: Request processed in 23us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790651.309479:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00080000:0.0:1787790651.309953:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787790651.309957:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790651.310011:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236497536 00000100:00100000:2.0:1787790651.310017:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236497536 00000100:00100000:2.0:1787790651.310056:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 129 00000100:00100000:2.0:1787790651.310073:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+10:2349:x1874634236497536:12345-192.168.201.25@tcp:400: 00000100:00100000:2.0:1787790651.310122:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+10:2349:x1874634236497536:12345-192.168.201.25@tcp:400: Request processed in 51us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790651.310129:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 129 00000100:00100000:0.0:1787790651.458264:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790651.458302:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253296384:0@lo:13: 00000100:00100000:0.0:1787790651.458402:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790651.464253:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253296384 00000100:00100000:2.0:1787790651.464270:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253296384 00000100:00080000:0.0:1787790651.464362:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790651.464375:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787790651.464388:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253296384:12345-0@lo:13: 00002000:00000024:2.0:1787790651.464426:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787790651.464537:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253296384:12345-0@lo:13: Request processed in 151us (6135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790651.464563:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787790651.464789:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a45dbf480 x1874634253296384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790651.464819:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253296384:0@lo:13: 00000001:02000400:3.0:1787790651.571046:0:8285:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787790652.161059:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790652.481910:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253296512:0@lo:400: 00000100:00100000:0.0:1787790652.482019:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790652.482072:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253297024:0@lo:400: 00000100:00100000:0.0:1787790652.482140:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790652.482172:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790652.482178:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81014780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253296896:0@lo:400: 00000100:00100000:0.0:1787790652.482207:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790652.482215:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253296512 00000100:00100000:1.0:1787790652.482225:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253296512 00000100:00100000:0.0:1787790652.482237:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253297024 00000100:00100000:0.0:1787790652.482241:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253297024 00000100:00100000:1.0:1787790652.482275:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787790652.482282:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787790652.482284:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253296512:12345-0@lo:400: 00000100:00100000:0.0:1787790652.482289:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253297024:12345-0@lo:400: 00000100:00100000:0.0:1787790652.482341:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253297024:12345-0@lo:400: Request processed in 53us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790652.482355:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787790652.482383:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253296896 00000100:00100000:0.0:1787790652.482387:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253296896 00000100:00100000:0.0:1787790652.482412:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787790652.482419:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ee8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253296896:12345-0@lo:400: 00000100:00100000:2.0:1787790652.482424:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1874634253296768:0@lo:400: 00000100:00100000:2.0:1787790652.482456:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790652.482479:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787790652.482484:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253296640:0@lo:400: 00000100:00100000:2.0:1787790652.482507:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790652.482525:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81017c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253297152:0@lo:400: 00000100:00100000:2.0:1787790652.482563:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790652.482591:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253296768 00000100:00100000:2.0:1787790652.482594:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253296768 00000100:00100000:2.0:1787790652.482620:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253296640 00000100:00100000:2.0:1787790652.482623:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253296640 00000100:00100000:2.0:1787790652.482636:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787790652.482642:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874634253296768:12345-0@lo:400: 00000100:00100000:3.0:1787790652.482669:0:6683:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787790652.482672:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874634253296768:12345-0@lo:400: Request processed in 30us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790652.482678:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787790652.482679:0:6683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787790652.482691:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787790652.482697:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253296640:12345-0@lo:400: 00000100:00080000:3.0:1787790652.482705:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790652.482743:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253297280:0@lo:13: 00000100:00100000:2.0:1787790652.482750:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253296640:12345-0@lo:400: Request processed in 53us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790652.482756:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787790652.482773:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790652.483123:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253296640:0@lo:400: 00000100:00100000:3.0:1787790652.483134:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1874634253296768:0@lo:400: 00000100:00100000:3.0:1787790652.483178:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253297280 00000100:00100000:3.0:1787790652.483182:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253297280 00000100:00100000:3.0:1787790652.483217:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787790652.483224:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81014f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253297280:12345-0@lo:13: 00002000:00000024:3.0:1787790652.483261:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790652.483308:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81014f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253297280:12345-0@lo:13: Request processed in 84us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790652.483315:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787790652.483338:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787790652.483359:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a81014b40 x1874634253297280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790652.483377:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253297280:0@lo:13: 00000100:00100000:3.0:1787790652.483415:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787790652.483423:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253297152 00000100:00100000:3.0:1787790652.483426:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253297152 00000100:00100000:3.0:1787790652.483441:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787790652.483447:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787790652.483452:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253297152:12345-0@lo:400: 00000100:00100000:1.0:1787790652.483453:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253296512:12345-0@lo:400: Request processed in 1170us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790652.483461:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787790652.483485:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253297152:12345-0@lo:400: Request processed in 32us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790652.483491:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787790652.483568:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ee8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253296896:12345-0@lo:400: Request processed in 1148us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790652.483576:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787790652.483639:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a81014780 x1874634253296896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790652.483664:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81014780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253296896:0@lo:400: 00000100:00100000:3.0:1787790652.483676:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253296512:0@lo:400: 00000100:00100000:3.0:1787790652.483686:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253297024:0@lo:400: 00010000:00080000:3.0:1787790652.483713:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a81017c00 x1874634253297152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790652.484010:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81017c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253297152:0@lo:400: 00010000:00010000:0.0:1787790653.187330:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790654.210843:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790655.233076:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787790655.639315:0:8434:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3bd0ded0 20000000:00000080:0.0:1787790655.639335:0:8434:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff931a7daff000 uarg=0000000000000000 20000000:01000000:0.0:1787790655.639373:0:8434:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787790655.639375:0:8434:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787790655.639378:0:8434:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787790655.639383:0:8434:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787790655.639388:0:8434:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787790655.639404:0:8434:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787790655.639405:0:8434:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787790655.639602:0:8434:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787790655.639606:0:8434:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787790655.640842:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1787790655.641288:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1787790655.641339:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1787790655.641360:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1787790655.641369:0:8434:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787790655.641371:0:8434:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787790655.642098:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787790655.642510:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787790655.642575:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1787790655.642609:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1787790655.642623:0:8434:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787790655.642626:0:8434:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787790655.644566:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1787790655.645155:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1787790655.645201:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1787790655.645251:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1787790655.645261:0:8434:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787790655.645263:0:8434:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787790655.645678:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1787790655.645996:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1787790655.646044:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1787790655.646080:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:0.0:1787790655.646095:0:8434:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787790655.646118:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff931a40031600/0x70647b5fa9774250 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.646135:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a40030200/0x70647b5fa977414d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9774146 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.646141:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a40030e00/0x70647b5fa9774177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9774170 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.646151:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a41479200/0x70647b5fa97741a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa977419a expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.646156:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a41479800/0x70647b5fa97741af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97741a8 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.646160:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a40030400/0x70647b5fa97741bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97741b6 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.646164:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a542f1e00/0x70647b5fa97741d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97741d2 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.646167:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a41479e00/0x70647b5fa9774203 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97741fc expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.646174:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a45704a00/0x70647b5fa9774211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e925 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.646178:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a45705e00/0x70647b5fa9774218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e92c expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.646185:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff931a40031600/0x70647b5fa9774250 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.646236:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a45705e00/0x70647b5fa9774218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e92c expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.646251:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff931a45705e00/0x70647b5fa9774218 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e92c expref: 9 pid: 5841 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790655.646274:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874634253297408:192.168.201.25@tcp:104: 00010000:00010000:0.0:1787790655.646426:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a45704a00/0x70647b5fa9774211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e925 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.646433:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff931a45704a00/0x70647b5fa9774211 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e925 expref: 9 pid: 5841 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790655.646440:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d80a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874634253297536:192.168.201.25@tcp:104: 00010000:00010000:0.0:1787790655.646463:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a41479e00/0x70647b5fa9774203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa97741fc expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.646468:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a41479e00/0x70647b5fa9774203 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa97741fc expref: 18 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790655.646474:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d808780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874634253297664:0@lo:104: 00000100:00100000:0.0:1787790655.646510:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787790655.646542:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a542f1e00/0x70647b5fa97741d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa97741d2 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.646547:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a542f1e00/0x70647b5fa97741d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa97741d2 expref: 18 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790655.646553:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d80bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874634253297792:0@lo:104: 00000100:00100000:0.0:1787790655.646568:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790655.646600:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787790655.646614:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253297664 00000100:00100000:0.0:1787790655.646620:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253297664 00000100:00100000:0.0:1787790655.646671:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253297792 00000100:00100000:0.0:1787790655.646673:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253297792 00000100:00100000:0.0:1787790655.646686:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787790655.646692:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d808000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+4:8434:x1874634253297664:12345-0@lo:104: 00010000:00010000:0.0:1787790655.646704:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a52848c00/0x70647b5fa97741fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9774203 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.647360:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787790655.647377:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d808000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+4:8434:x1874634253297664:12345-0@lo:104: Request processed in 674us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790655.647385:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787790655.647407:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787790655.647412:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db61850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:8434:x1874634253297792:12345-0@lo:104: 00010000:00010000:0.0:1787790655.647419:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97741d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97741d9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.647446:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787790655.647449:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db61850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:8434:x1874634253297792:12345-0@lo:104: Request processed in 39us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790655.647453:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1787790655.647489:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787790655.647495:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a52848c00/0x70647b5fa97741fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9774203 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.647500:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a52848c00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:0.0:1787790655.647504:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a52848c00/0x70647b5fa97741fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa9774203 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.647511:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a52848c00/0x70647b5fa97741fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa9774203 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790655.647522:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a52848c00/0x70647b5fa97741fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa9774203 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790655.647526:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787790655.647554:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a52848c00/0x70647b5fa97741fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774203 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.647558:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790655.647573:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a52848c00/0x70647b5fa97741fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774203 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.647578:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a52848c00/0x70647b5fa97741fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774203 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.647589:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790655.647591:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97741d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97741d9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.647594:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a52849e00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:0.0:1787790655.647596:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97741d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa97741d9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.647601:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97741d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa97741d9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790655.647607:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97741d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa97741d9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790655.647613:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787790655.647632:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97741d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97741d9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.647638:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790655.647643:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97741d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97741d9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.647649:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97741d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97741d9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.647659:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790655.647661:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790655.647662:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790655.647669:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790655.647695:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a40030400/0x70647b5fa97741bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa97741b6 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.647703:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a40030400/0x70647b5fa97741bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa97741b6 expref: 18 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790655.647710:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d808f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874634253298176:0@lo:104: 00000100:00100000:0.0:1787790655.647744:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790655.647760:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253298176 00000100:00100000:0.0:1787790655.647764:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253298176 00000100:00100000:0.0:1787790655.647780:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787790655.647784:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:8434:x1874634253298176:12345-0@lo:104: 00010000:00010000:0.0:1787790655.647789:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97741b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97741bd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.647809:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787790655.647812:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:8434:x1874634253298176:12345-0@lo:104: Request processed in 29us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790655.647821:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1787790655.647831:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790655.647834:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97741b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97741bd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.647838:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f1400 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:0.0:1787790655.647840:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97741b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa97741bd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.647844:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97741b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa97741bd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790655.647847:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97741b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa97741bd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790655.647851:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787790655.647861:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97741b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97741bd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.647865:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790655.647877:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97741b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97741bd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.647881:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa97741b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97741bd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.647887:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790655.647888:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790655.647889:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790655.647897:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d80b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253298304:0@lo:103: 00000100:00100000:0.0:1787790655.647925:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790655.647967:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253298304 00000100:00100000:0.0:1787790655.647971:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253298304 00010000:00010000:0.0:1787790655.647987:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a40030400/0x70647b5fa97741bd lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97741b6 expref: 19 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790655.648005:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787790655.648009:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d80a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3320:x1874634253298304:12345-0@lo:103: 00010000:00010000:0.0:1787790655.648017:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790655.648021:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a40030400/0x70647b5fa97741bd lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97741b6 expref: 19 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648044:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a40030400/0x70647b5fa97741bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa97741b6 expref: 19 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648062:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790655.648088:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d80a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3320:x1874634253298304:12345-0@lo:103: Request processed in 78us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790655.648095:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787790655.648126:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d80b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253298304:0@lo:103: 00010000:00010000:0.0:1787790655.648149:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a41479800/0x70647b5fa97741af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa97741a8 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648155:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a41479800/0x70647b5fa97741af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa97741a8 expref: 18 pid: 5841 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790655.648161:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d80b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874634253298432:0@lo:104: 00000100:00100000:0.0:1787790655.648176:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790655.648192:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253298432 00000100:00100000:0.0:1787790655.648201:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253298432 00000100:00100000:0.0:1787790655.648219:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787790655.648224:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:8434:x1874634253298432:12345-0@lo:104: 00010000:00010000:0.0:1787790655.648232:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97741a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97741af expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648260:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787790655.648264:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:8434:x1874634253298432:12345-0@lo:104: Request processed in 41us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790655.648268:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1787790655.648278:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790655.648281:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97741a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97741af expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648286:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030000 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:0.0:1787790655.648288:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97741a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa97741af expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648293:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97741a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa97741af expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790655.648297:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97741a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa97741af expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790655.648300:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787790655.648311:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97741a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97741af expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648314:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790655.648319:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97741a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97741af expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648328:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97741a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97741af expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648335:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790655.648336:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790655.648337:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790655.648341:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790655.648346:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d8083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253298560:0@lo:103: 00000100:00100000:0.0:1787790655.648362:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787790655.648393:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a41479200/0x70647b5fa97741a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa977419a expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648399:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a41479200/0x70647b5fa97741a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa977419a expref: 18 pid: 5841 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790655.648405:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d809e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874634253298688:0@lo:104: 00000100:00100000:0.0:1787790655.648419:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790655.648431:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253298688 00000100:00100000:0.0:1787790655.648434:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253298688 00000100:00100000:0.0:1787790655.648445:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787790655.648448:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d809680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:8434:x1874634253298688:12345-0@lo:104: 00010000:00010000:0.0:1787790655.648453:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a52848a00/0x70647b5fa977419a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97741a1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648472:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787790655.648475:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d809680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:8434:x1874634253298688:12345-0@lo:104: Request processed in 27us (56us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790655.648479:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1787790655.648493:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790655.648496:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a52848a00/0x70647b5fa977419a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97741a1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648500:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a52848a00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:0.0:1787790655.648503:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a52848a00/0x70647b5fa977419a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa97741a1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648507:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a52848a00/0x70647b5fa977419a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa97741a1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790655.648510:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a52848a00/0x70647b5fa977419a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa97741a1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790655.648513:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787790655.648523:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a52848a00/0x70647b5fa977419a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97741a1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648527:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790655.648530:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a52848a00/0x70647b5fa977419a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97741a1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648534:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a52848a00/0x70647b5fa977419a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97741a1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648540:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790655.648541:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790655.648542:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790655.648553:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a40030e00/0x70647b5fa9774177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa9774170 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648559:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a40030e00/0x70647b5fa9774177 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa9774170 expref: 18 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790655.648568:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d80ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874634253298944:0@lo:104: 00000100:00100000:0.0:1787790655.648583:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790655.648596:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253298944 00000100:00100000:0.0:1787790655.648598:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253298944 00000100:00100000:0.0:1787790655.648613:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787790655.648619:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:8434:x1874634253298944:12345-0@lo:104: 00010000:00010000:0.0:1787790655.648626:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa9774170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9774177 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648655:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787790655.648660:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:8434:x1874634253298944:12345-0@lo:104: Request processed in 42us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790655.648665:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1787790655.648675:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790655.648678:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa9774170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9774177 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648682:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f0e00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:0.0:1787790655.648684:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa9774170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa9774177 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648689:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa9774170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa9774177 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790655.648693:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa9774170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa9774177 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790655.648696:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787790655.648711:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa9774170 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774177 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648715:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790655.648718:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa9774170 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774177 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648746:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a542f0e00/0x70647b5fa9774170 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774177 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648753:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790655.648754:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790655.648755:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790655.648786:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a40030200/0x70647b5fa977414d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa9774146 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648792:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a40030200/0x70647b5fa977414d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa9774146 expref: 18 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790655.648798:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c26a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874634253299200:0@lo:104: 00000100:00100000:0.0:1787790655.648816:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790655.648829:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253299200 00000100:00100000:0.0:1787790655.648831:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253299200 00000100:00100000:0.0:1787790655.648842:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787790655.648845:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c26b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:8434:x1874634253299200:12345-0@lo:104: 00010000:00010000:0.0:1787790655.648850:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa9774146 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa977414d expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648870:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787790655.648873:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c26b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:8434:x1874634253299200:12345-0@lo:104: Request processed in 27us (57us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790655.648881:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787790655.648892:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790655.648894:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa9774146 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa977414d expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648899:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a52849000 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:0.0:1787790655.648901:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa9774146 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa977414d expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648905:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa9774146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa977414d expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790655.648908:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa9774146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa977414d expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790655.648912:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787790655.648922:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa9774146 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa977414d expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648928:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790655.648937:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa9774146 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa977414d expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648943:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa9774146 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa977414d expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.648958:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790655.648960:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790655.648961:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790655.648971:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c2683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253299328:0@lo:103: 00000100:00100000:0.0:1787790655.648996:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790655.649015:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253298560 00000100:00100000:0.0:1787790655.649017:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253298560 00010000:00010000:0.0:1787790655.649043:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a41479800/0x70647b5fa97741af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97741a8 expref: 19 pid: 5841 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790655.649061:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253299328 00000100:00100000:0.0:1787790655.649064:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253299328 00010000:00010000:0.0:1787790655.649076:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a40030200/0x70647b5fa977414d lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9774146 expref: 20 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790655.649088:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787790655.649094:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d809a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+20:3320:x1874634253298560:12345-0@lo:103: 00010000:00010000:0.0:1787790655.649101:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790655.649104:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a41479800/0x70647b5fa97741af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97741a8 expref: 20 pid: 5841 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.649110:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a41479800/0x70647b5fa97741af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa97741a8 expref: 20 pid: 5841 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.649119:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790655.649137:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d809a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+20:3320:x1874634253298560:12345-0@lo:103: Request processed in 45us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790655.649141:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787790655.649151:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787790655.649155:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c269a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3320:x1874634253299328:12345-0@lo:103: 00010000:00010000:0.0:1787790655.649160:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790655.649163:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a40030200/0x70647b5fa977414d lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9774146 expref: 19 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.649176:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a40030200/0x70647b5fa977414d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa9774146 expref: 19 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790655.649185:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790655.649206:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c269a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3320:x1874634253299328:12345-0@lo:103: Request processed in 48us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790655.649212:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787790655.649242:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c2683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253299328:0@lo:103: 00000100:00100000:0.0:1787790655.649249:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d8083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253298560:0@lo:103: 00000100:00100000:0.0:1787790655.649266:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82600 going to sleep for 11 seconds 00000100:00100000:0.0:1787790655.649276:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d808780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874634253297664:0@lo:104: 00000100:00100000:0.0:1787790655.649282:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d80bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874634253297792:0@lo:104: 00010000:00010000:0.0:1787790655.649287:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a40030400/0x70647b5fa97741bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa97741b6 expref: 18 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790655.649294:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d808f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874634253298176:0@lo:104: 00010000:00010000:0.0:1787790655.649298:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a41479800/0x70647b5fa97741af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa97741a8 expref: 17 pid: 5841 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790655.649304:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d80b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874634253298432:0@lo:104: 00000100:00100000:0.0:1787790655.649308:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d809e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874634253298688:0@lo:104: 00000100:00100000:0.0:1787790655.649312:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d80ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874634253298944:0@lo:104: 00010000:00010000:0.0:1787790655.649315:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a40030200/0x70647b5fa977414d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa9774146 expref: 16 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790655.649319:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c26a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874634253299200:0@lo:104: 00000100:00100000:3.0:1787790655.649421:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253298048:0@lo:103: 00000100:00100000:3.0:1787790655.649445:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790655.649465:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253299072:0@lo:103: 00000100:00100000:3.0:1787790655.649476:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790655.649488:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787790655.649491:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253297920:0@lo:103: 00000100:00100000:3.0:1787790655.649502:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790655.649507:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d80b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253298816:0@lo:103: 00000100:00100000:3.0:1787790655.649519:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790655.649534:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253298048 00000100:00100000:3.0:1787790655.649537:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253298048 00010000:00010000:3.0:1787790655.649554:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a542f1e00/0x70647b5fa97741d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97741d2 expref: 16 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790655.649563:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253299072 00000100:00100000:3.0:1787790655.649564:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253299072 00010000:00010000:3.0:1787790655.649570:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a40030e00/0x70647b5fa9774177 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9774170 expref: 17 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790655.649575:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253297920 00000100:00100000:3.0:1787790655.649577:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253297920 00010000:00010000:3.0:1787790655.649582:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a41479e00/0x70647b5fa9774203 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97741fc expref: 18 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790655.649588:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253298816 00000100:00100000:3.0:1787790655.649589:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253298816 00010000:00010000:3.0:1787790655.649593:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a41479200/0x70647b5fa97741a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa977419a expref: 19 pid: 5841 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790655.649601:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787790655.649606:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81014780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253298048:12345-0@lo:103: 00010000:00010000:3.0:1787790655.649613:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790655.649617:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a542f1e00/0x70647b5fa97741d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97741d2 expref: 19 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.649624:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a542f1e00/0x70647b5fa97741d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa97741d2 expref: 19 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.649634:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a542f1e00/0x70647b5fa97741d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa97741d2 expref: 19 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.649645:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790655.649670:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81014780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:3319:x1874634253298048:12345-0@lo:103: Request processed in 64us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790655.649678:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787790655.649691:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787790655.649695:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81014b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:3319:x1874634253299072:12345-0@lo:103: 00010000:00010000:3.0:1787790655.649700:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790655.649703:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a40030e00/0x70647b5fa9774177 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9774170 expref: 17 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.649709:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a40030e00/0x70647b5fa9774177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa9774170 expref: 17 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.649716:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a40030e00/0x70647b5fa9774177 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa9774170 expref: 17 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.649739:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790655.649755:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81014b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:3319:x1874634253299072:12345-0@lo:103: Request processed in 60us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790655.649759:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787790655.649766:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787790655.649770:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a810152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:3319:x1874634253297920:12345-0@lo:103: 00010000:00010000:3.0:1787790655.649774:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790655.649777:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a41479e00/0x70647b5fa9774203 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97741fc expref: 15 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.649782:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a41479e00/0x70647b5fa9774203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa97741fc expref: 15 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.649789:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a41479e00/0x70647b5fa9774203 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa97741fc expref: 15 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.649803:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790655.649817:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a810152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:3319:x1874634253297920:12345-0@lo:103: Request processed in 47us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790655.649821:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787790655.649829:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787790655.649833:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a493cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:3319:x1874634253298816:12345-0@lo:103: 00010000:00010000:3.0:1787790655.649838:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790655.649841:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a41479200/0x70647b5fa97741a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa977419a expref: 13 pid: 5841 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.649846:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a41479200/0x70647b5fa97741a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa977419a expref: 13 pid: 5841 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.649852:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a41479200/0x70647b5fa97741a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa977419a expref: 13 pid: 5841 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.649857:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790655.649868:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a493cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:3319:x1874634253298816:12345-0@lo:103: Request processed in 36us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790655.649871:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787790655.649903:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253297920:0@lo:103: 00000100:00100000:3.0:1787790655.649907:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d80b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253298816:0@lo:103: 00000100:00100000:3.0:1787790655.649912:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253298048:0@lo:103: 00000100:00100000:3.0:1787790655.649915:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253299072:0@lo:103: 00000100:00100000:0.0:1787790655.670825:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874634253297408:192.168.201.25@tcp:104: 00000100:00100000:0.0:1787790655.670843:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d80a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874634253297536:192.168.201.25@tcp:104: 00010000:00010000:0.0:1787790655.670951:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff931a40031600/0x70647b5fa9774250 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790655.672853:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790655.673302:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790655.673456:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236498176 00000100:00100000:3.0:1787790655.673477:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236498176 00010000:00010000:3.0:1787790655.673524:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a45704a00/0x70647b5fa9774211 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e925 expref: 10 pid: 5841 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790655.673558:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236498048 00000100:00100000:3.0:1787790655.673561:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236498048 00010000:00010000:3.0:1787790655.673575:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a45705e00/0x70647b5fa9774218 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e92c expref: 11 pid: 5841 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790655.673603:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:3.0:1787790655.673614:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c26a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b956aedb-a574-46fa-b700-b912aca9a68a+11:2348:x1874634236498176:12345-192.168.201.25@tcp:103: 00010000:00010000:3.0:1787790655.673629:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790655.673635:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a45704a00/0x70647b5fa9774211 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e925 expref: 11 pid: 5841 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.673645:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a45704a00/0x70647b5fa9774211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e925 expref: 11 pid: 5841 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.673663:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a45704a00/0x70647b5fa9774211 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e925 expref: 11 pid: 5841 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.673680:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790655.673762:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c26a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b956aedb-a574-46fa-b700-b912aca9a68a+10:2348:x1874634236498176:12345-192.168.201.25@tcp:103: Request processed in 147us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790655.673771:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:3.0:1787790655.673797:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:3.0:1787790655.673806:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c2683c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b956aedb-a574-46fa-b700-b912aca9a68a+9:2348:x1874634236498048:12345-192.168.201.25@tcp:103: 00010000:00010000:3.0:1787790655.673816:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790655.673821:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a45705e00/0x70647b5fa9774218 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e92c expref: 9 pid: 5841 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.673855:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a45705e00/0x70647b5fa9774218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e92c expref: 9 pid: 5841 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.673867:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a45705e00/0x70647b5fa9774218 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e92c expref: 9 pid: 5841 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.673881:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff931a40031600/0x70647b5fa9774250 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.673892:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a40031600/0x70647b5fa9774250 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.673910:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a40031600/0x70647b5fa9774250 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.673918:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a40031600/0x70647b5fa9774250 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.673925:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff931a40031600/0x70647b5fa9774250 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.673932:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff931a40031600/0x70647b5fa9774250 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.673937:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40031600 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790655.673942:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff931a40031600/0x70647b5fa9774250 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.673950:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff931a40031600/0x70647b5fa9774250 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.673987:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff931a40031600/0x70647b5fa9774250 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790655.673999:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790655.674044:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c2683c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b956aedb-a574-46fa-b700-b912aca9a68a+8:2348:x1874634236498048:12345-192.168.201.25@tcp:103: Request processed in 239us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790655.674051:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00010000:00010000:2.0:1787790655.674073:0:8434:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff931a40031600/0x70647b5fa9774250 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790655.674091:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff931a40031600/0x70647b5fa9774250 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790655.674109:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a40031600/0x70647b5fa9774250 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790656.257398:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790656.429689:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790656.429771:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790656.429807:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790656.429852:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790656.429883:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236498688 00000100:00100000:0.0:1787790656.429892:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236498688 00000100:00100000:1.0:1787790656.429908:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236498304 00000100:00100000:1.0:1787790656.429912:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236498304 00000100:00100000:0.0:1787790656.429944:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236498560 00000100:00100000:0.0:1787790656.429946:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236498560 00000100:00100000:1.0:1787790656.429949:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 131 00000100:00100000:1.0:1787790656.429957:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+8:2348:x1874634236498304:12345-192.168.201.25@tcp:400: 00000100:00100000:0.0:1787790656.429965:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:0.0:1787790656.429972:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c269680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2348:x1874634236498688:12345-192.168.201.25@tcp:400: 00000100:00100000:1.0:1787790656.430038:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+8:2348:x1874634236498304:12345-192.168.201.25@tcp:400: Request processed in 81us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790656.430046:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 131 00000100:00100000:0.0:1787790656.430105:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c269680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2348:x1874634236498688:12345-192.168.201.25@tcp:400: Request processed in 133us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790656.430106:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:0.0:1787790656.430128:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:1.0:1787790656.430131:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c26b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2348:x1874634236498560:12345-192.168.201.25@tcp:400: 00000100:00100000:1.0:1787790656.430157:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c26b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2348:x1874634236498560:12345-192.168.201.25@tcp:400: Request processed in 28us (306us total) trans 0 rc 0/0 00000100:00080000:0.0:1787790656.430158:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787790656.430161:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790656.430163:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:2.0:1787790656.432146:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236498432 00000100:00100000:2.0:1787790656.432157:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236498432 00000100:00100000:2.0:1787790656.432235:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:2.0:1787790656.432244:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c269e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2348:x1874634236498432:12345-192.168.201.25@tcp:400: 00000100:00100000:2.0:1787790656.432299:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c269e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2348:x1874634236498432:12345-192.168.201.25@tcp:400: Request processed in 56us (2617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790656.432305:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00080000:0.0:1787790656.432950:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790656.578327:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790656.578353:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253299456:0@lo:13: 00000100:00100000:0.0:1787790656.578423:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790656.578492:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253299456 00000100:00100000:0.0:1787790656.578510:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253299456 00000100:00100000:0.0:1787790656.578564:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787790656.578573:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c26ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253299456:12345-0@lo:13: 00002000:00000024:0.0:1787790656.578608:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787790656.578650:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c26ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253299456:12345-0@lo:13: Request processed in 78us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790656.578656:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787790656.578680:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787790656.578713:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a45dbc780 x1874634253299456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790672 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790656.578748:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253299456:0@lo:13: 10000000:01000000:3.0:1787790657.151865:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787790657.151873:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9319447e6800 from 39 10000000:01000000:3.0:1787790657.151879:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787790657.151927:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a52848400/0x70647b5fa9774257 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790657.151938:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a52848400/0x70647b5fa9774257 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790657.151949:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a52848400/0x70647b5fa9774257 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790657.151973:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81014780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253299584:0@lo:101: 00000100:00100000:3.0:1787790657.152053:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790657.152116:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a456cbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787790657.152210:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253299584 00000100:00100000:1.0:1787790657.152218:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253299584 00000100:00100000:1.0:1787790657.152273:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787790657.152282:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+12:5843:x1874634253299584:12345-0@lo:101: 00010000:00010000:1.0:1787790657.152295:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790657.152308:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a45705a00/0x70647b5fa977425e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9774257 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790657.152331:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a45705a00/0x70647b5fa977425e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9774257 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790657.152342:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a45705a00/0x70647b5fa977425e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9774257 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790657.152352:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45705a00, rc 0) 00000100:00100000:1.0:1787790657.152398:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:5843:x1874634253299584:12345-0@lo:101: Request processed in 117us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790657.152406:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787790657.152441:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81014780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253299584:0@lo:101: 00010000:00010000:2.0:1787790657.152459:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a52848400/0x70647b5fa9774257 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977425e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790657.152470:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a52848400/0x70647b5fa9774257 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa977425e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790657.152525:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db6b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253299712:0@lo:501: 00000100:00100000:2.0:1787790657.152554:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790657.152629:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d83a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787790657.152670:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253299712 00000100:00100000:1.0:1787790657.152674:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253299712 00000100:00100000:1.0:1787790657.152753:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787790657.152760:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:5843:x1874634253299712:12345-0@lo:501: 00000100:00100000:1.0:1787790657.153079:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:5843:x1874634253299712:12345-0@lo:501: Request processed in 318us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790657.153096:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787790657.153381:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db6b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253299712:0@lo:501: 00000100:00100000:3.0:1787790657.153419:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253299840:0@lo:503: 00000100:00100000:3.0:1787790657.153460:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790657.153526:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a456cb900 going to sleep for 11 seconds 00000100:00100000:1.0:1787790657.153561:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253299840 00000100:00100000:1.0:1787790657.153565:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253299840 00000100:00100000:1.0:1787790657.153600:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787790657.153606:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:5843:x1874634253299840:12345-0@lo:503: 00000100:00100000:1.0:1787790657.153944:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:5843:x1874634253299840:12345-0@lo:503: Request processed in 337us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790657.153951:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787790657.154056:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253299840:0@lo:503: 00000100:00100000:0.0:1787790657.154439:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c26a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8452:1874634253299968:0@lo:502: 00000100:00100000:0.0:1787790657.154478:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790657.154549:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790657.154587:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253299968 00000100:00100000:2.0:1787790657.154591:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253299968 00000100:00100000:2.0:1787790657.154658:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787790657.154666:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:8452:x1874634253299968:12345-0@lo:502: 00000100:00100000:2.0:1787790657.154990:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:8452:x1874634253299968:12345-0@lo:502: Request processed in 324us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790657.155015:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787790657.155086:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c26a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8452:1874634253299968:0@lo:502: 00000100:00100000:0.0:1787790657.155126:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c26a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8452:1874634253300096:0@lo:502: 00000100:00100000:0.0:1787790657.155157:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790657.155247:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787790657.155310:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253300096 00000100:00100000:1.0:1787790657.155314:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253300096 00000100:00100000:1.0:1787790657.155333:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787790657.155339:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:8452:x1874634253300096:12345-0@lo:502: 00000100:00100000:1.0:1787790657.155474:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:8452:x1874634253300096:12345-0@lo:502: Request processed in 134us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790657.155480:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787790657.155554:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c26a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8452:1874634253300096:0@lo:502: 00000040:00080000:0.0:1787790657.155574:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787790657.155742:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787790657.155762:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787790657.155771:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a52848400/0x70647b5fa9774257 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977425e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790657.155781:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a52848400/0x70647b5fa9774257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977425e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790657.155801:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787790657.155804:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787790657.155977:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787790657.156012:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9774265 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790657.156030:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9774265 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790657.156041:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9774265 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790657.156055:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253300224:0@lo:101: 00000100:00100000:1.0:1787790657.156100:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790657.156124:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b64a600 going to sleep for 11 seconds 00000100:00100000:0.0:1787790657.156168:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253300224 00000100:00100000:0.0:1787790657.156173:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253300224 00000100:00100000:0.0:1787790657.156192:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787790657.156198:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+13:5843:x1874634253300224:12345-0@lo:101: 00010000:00010000:0.0:1787790657.156206:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790657.156218:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a40030200/0x70647b5fa977426c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9774265 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790657.156243:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a40030200/0x70647b5fa977426c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9774265 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790657.156252:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a40030200/0x70647b5fa977426c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9774265 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790657.156261:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a40030200, rc 0) 00000100:00100000:0.0:1787790657.156297:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:5843:x1874634253300224:12345-0@lo:101: Request processed in 98us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790657.156303:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787790657.156367:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253300224:0@lo:101: 00010000:00010000:1.0:1787790657.156380:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9774265 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977426c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790657.156387:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9774265 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa977426c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790657.156429:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253300352:0@lo:501: 00000100:00100000:1.0:1787790657.156456:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790657.156483:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b64a600 going to sleep for 11 seconds 00000100:00100000:0.0:1787790657.156528:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253300352 00000100:00100000:0.0:1787790657.156533:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253300352 00000100:00100000:0.0:1787790657.156551:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787790657.156557:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:5843:x1874634253300352:12345-0@lo:501: 00000100:00100000:0.0:1787790657.156784:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:5843:x1874634253300352:12345-0@lo:501: Request processed in 226us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790657.156800:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787790657.156970:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253300352:0@lo:501: 00000100:00100000:1.0:1787790657.156995:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253300480:0@lo:503: 00000100:00100000:1.0:1787790657.157041:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790657.157068:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b64a600 going to sleep for 11 seconds 00000100:00100000:0.0:1787790657.157110:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253300480 00000100:00100000:0.0:1787790657.157114:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253300480 00000100:00100000:0.0:1787790657.157132:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787790657.157138:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:5843:x1874634253300480:12345-0@lo:503: 00000100:00100000:0.0:1787790657.157310:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:5843:x1874634253300480:12345-0@lo:503: Request processed in 171us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790657.157316:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787790657.157486:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253300480:0@lo:503: 00000100:00100000:3.0:1787790657.157990:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8453:1874634253300608:0@lo:502: 00000100:00100000:3.0:1787790657.158040:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790657.158101:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a456cb600 going to sleep for 11 seconds 00000100:00100000:0.0:1787790657.158137:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253300608 00000100:00100000:0.0:1787790657.158141:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253300608 00000100:00100000:0.0:1787790657.158206:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787790657.158220:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46532850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:8453:x1874634253300608:12345-0@lo:502: 00000100:00100000:0.0:1787790657.158372:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46532850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:8453:x1874634253300608:12345-0@lo:502: Request processed in 153us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790657.158379:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787790657.158440:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8453:1874634253300608:0@lo:502: 00000020:01000000:3.0:1787790657.158462:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790657.158471:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790657.158473:0:8453:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787790657.158479:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787790657.158500:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8453:1874634253300736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790657.158530:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790657.158622:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a456cb600 going to sleep for 11 seconds 00000100:00100000:2.0:1787790657.158692:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253300736 00000100:00100000:2.0:1787790657.158696:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253300736 00000100:00100000:2.0:1787790657.158716:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787790657.158740:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46533850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:8453:x1874634253300736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790657.158983:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46533850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:8453:x1874634253300736:12345-0@lo:502:llog_process_th.0 Request processed in 261us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790657.158990:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787790657.159076:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8453:1874634253300736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787790657.159092:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790657.159096:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790657.159098:0:8453:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787790657.159101:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787790657.159240:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787790657.159259:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787790657.159268:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9774265 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977426c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790657.159277:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9774265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977426c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790657.159287:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787790657.159290:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff931a493ae800 from 39 10000000:01000000:2.0:1787790657.159293:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787790657.159315:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f0800/0x70647b5fa9774273 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790657.159323:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a542f0800/0x70647b5fa9774273 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790657.159331:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a542f0800/0x70647b5fa9774273 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790657.159345:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db6a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253300864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787790657.159380:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790657.159407:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d83ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790657.159452:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253300864 00000100:00100000:3.0:1787790657.159456:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253300864 00000100:00100000:3.0:1787790657.159477:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787790657.159482:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:5843:x1874634253300864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790657.159489:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790657.159501:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a52849400/0x70647b5fa977427a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9774273 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790657.159517:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a52849400/0x70647b5fa977427a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9774273 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790657.159526:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a52849400/0x70647b5fa977427a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9774273 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790657.159539:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a52849400, rc 0) 00000100:00100000:3.0:1787790657.159577:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:5843:x1874634253300864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790657.159582:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787790657.159647:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db6a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253300864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790657.159658:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a542f0800/0x70647b5fa9774273 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977427a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790657.159666:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a542f0800/0x70647b5fa9774273 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa977427a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790657.159706:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db6a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253300992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790657.159927:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790657.159975:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d83ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787790657.161678:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253300992 00000100:00100000:0.0:1787790657.161689:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253300992 00000100:00100000:1.0:1787790657.161943:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787790657.161966:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:5843:x1874634253300992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790657.162265:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:5843:x1874634253300992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (2337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790657.162273:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787790657.162353:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db6a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253300992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790657.162401:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db6a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253301120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790657.162444:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790657.162709:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d83ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790657.162776:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253301120 00000100:00100000:3.0:1787790657.162781:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253301120 00000100:00100000:3.0:1787790657.162916:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787790657.162923:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46533450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:5843:x1874634253301120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790657.163190:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46533450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:5843:x1874634253301120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 267us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790657.163199:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787790657.163349:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db6a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253301120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787790657.163652:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8454:1874634253301248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790657.163692:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790657.164044:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4cbf5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790657.169148:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253301248 00000100:00100000:3.0:1787790657.169163:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253301248 00000100:00100000:3.0:1787790657.169235:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787790657.169246:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46533c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:8454:x1874634253301248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790657.169535:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46533c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:8454:x1874634253301248:12345-0@lo:502:llog_process_th.0 Request processed in 290us (5841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790657.169542:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787790657.169781:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8454:1874634253301248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790657.169865:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8454:1874634253301376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790657.169910:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790657.169941:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4cbf5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790657.172589:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253301376 00000100:00100000:3.0:1787790657.172601:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253301376 00000100:00100000:3.0:1787790657.172694:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787790657.172704:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46531450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:8454:x1874634253301376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790657.173104:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46531450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:8454:x1874634253301376:12345-0@lo:502:llog_process_th.0 Request processed in 400us (3192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790657.173111:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787790657.173233:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8454:1874634253301376:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787790657.173266:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787790657.173569:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787790657.173587:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787790657.173597:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f0800/0x70647b5fa9774273 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977427a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790657.173607:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a542f0800/0x70647b5fa9774273 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977427a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790657.173616:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787790657.173619:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787790657.173621:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787790657.173652:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40030400/0x70647b5fa9774281 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790657.173659:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a40030400/0x70647b5fa9774281 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790657.173668:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a40030400/0x70647b5fa9774281 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790657.173687:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c26a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253301504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787790657.173754:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790657.175502:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253301504 00000100:00100000:2.0:1787790657.175513:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253301504 00000100:00100000:2.0:1787790657.175554:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787790657.175563:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46530c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:5843:x1874634253301504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790657.175577:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790657.175591:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a542f0000/0x70647b5fa9774288 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9774281 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790657.175615:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a542f0000/0x70647b5fa9774288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9774281 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790657.175639:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a542f0000/0x70647b5fa9774288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9774281 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790657.175648:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f0000, rc 0) 00000100:00100000:2.0:1787790657.175696:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46530c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:5843:x1874634253301504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (1974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790657.175702:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787790657.175864:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82600 going to sleep for 11 seconds 00000100:00100000:0.0:1787790657.175886:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c26a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253301504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790657.175907:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a40030400/0x70647b5fa9774281 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774288 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790657.175915:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a40030400/0x70647b5fa9774281 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9774288 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790657.175976:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c26a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253301632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790657.176027:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790657.176051:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82600 going to sleep for 11 seconds 00000100:00100000:2.0:1787790657.176532:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253301632 00000100:00100000:2.0:1787790657.176538:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253301632 00000100:00100000:2.0:1787790657.176560:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787790657.176566:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46531850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:5843:x1874634253301632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790657.176854:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46531850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:5843:x1874634253301632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790657.176861:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787790657.177102:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c26a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253301632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790657.177140:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c26a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253301760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790657.177191:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790657.177211:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82600 going to sleep for 11 seconds 00000100:00100000:2.0:1787790657.177299:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253301760 00000100:00100000:2.0:1787790657.177304:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253301760 00000100:00100000:2.0:1787790657.177324:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787790657.177329:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46530850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:5843:x1874634253301760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790657.177474:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46530850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:5843:x1874634253301760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790657.177481:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787790657.177597:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c26a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253301760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790657.178231:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c26a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8455:1874634253301888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790657.178274:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790657.178305:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82000 going to sleep for 11 seconds 00000100:00100000:2.0:1787790657.178400:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253301888 00000100:00100000:2.0:1787790657.178405:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253301888 00000100:00100000:2.0:1787790657.178424:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787790657.178430:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45663450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:8455:x1874634253301888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790657.178575:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45663450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:8455:x1874634253301888:12345-0@lo:502:llog_process_th.0 Request processed in 144us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790657.178586:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787790657.178651:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c26a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8455:1874634253301888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787790657.178671:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790657.178679:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790657.178681:0:8455:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787790657.178686:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787790657.178702:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c26a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8455:1874634253302016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790657.178758:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790657.178772:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82000 going to sleep for 11 seconds 00000100:00100000:2.0:1787790657.178908:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253302016 00000100:00100000:2.0:1787790657.178912:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253302016 00000100:00100000:2.0:1787790657.178927:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787790657.178932:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:8455:x1874634253302016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790657.179049:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:8455:x1874634253302016:12345-0@lo:502:llog_process_th.0 Request processed in 115us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790657.179055:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787790657.179212:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c26a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8455:1874634253302016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787790657.179229:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790657.179233:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790657.179235:0:8455:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787790657.179238:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1787790657.179367:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787790657.179384:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787790657.179392:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40030400/0x70647b5fa9774281 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774288 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790657.179403:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a40030400/0x70647b5fa9774281 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774288 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790657.179412:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787790657.179415:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff931a4977d000 from 39 10000000:01000000:2.0:1787790657.179417:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787790657.179439:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f1e00/0x70647b5fa977428f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790657.179447:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a542f1e00/0x70647b5fa977428f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790657.179456:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a542f1e00/0x70647b5fa977428f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790657.179468:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db6a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253302144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787790657.179498:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790657.179518:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d83af00 going to sleep for 11 seconds 00000100:00100000:3.0:1787790657.179557:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253302144 00000100:00100000:3.0:1787790657.179560:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253302144 00000100:00100000:3.0:1787790657.179589:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787790657.179595:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45661450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:5843:x1874634253302144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790657.179603:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790657.179614:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a52848800/0x70647b5fa9774296 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa977428f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790657.179632:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a52848800/0x70647b5fa9774296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa977428f expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790657.179642:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a52848800/0x70647b5fa9774296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa977428f expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790657.179650:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a52848800, rc 0) 00000100:00100000:3.0:1787790657.179683:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45661450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253302144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790657.179689:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787790657.179749:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db6a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253302144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790657.179760:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a542f1e00/0x70647b5fa977428f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774296 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790657.179769:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a542f1e00/0x70647b5fa977428f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9774296 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790657.179823:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db6a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253302272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790657.179843:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790657.179861:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d83af00 going to sleep for 11 seconds 00000100:00100000:3.0:1787790657.180045:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253302272 00000100:00100000:3.0:1787790657.180049:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253302272 00000100:00100000:3.0:1787790657.180064:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787790657.180069:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45660c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253302272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790657.180264:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45660c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253302272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790657.180270:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787790657.181014:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db6a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253302272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790657.181050:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db6a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253302400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790657.181089:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790657.181118:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d83af00 going to sleep for 11 seconds 00000100:00100000:0.0:1787790657.181290:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253302400 00000100:00100000:0.0:1787790657.181294:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253302400 00000100:00100000:0.0:1787790657.181325:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787790657.181332:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45661850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253302400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790657.181465:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45661850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253302400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790657.181472:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787790657.181555:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db6a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253302400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790657.182023:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db6a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8456:1874634253302528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790657.182064:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790657.182094:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d83ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790657.182137:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253302528 00000100:00100000:0.0:1787790657.182142:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253302528 00000100:00100000:0.0:1787790657.182237:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787790657.182245:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45660850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:8456:x1874634253302528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790657.182408:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45660850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:8456:x1874634253302528:12345-0@lo:502:llog_process_th.0 Request processed in 163us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790657.182413:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787790657.182513:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db6a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8456:1874634253302528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790657.182555:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db6a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8456:1874634253302656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790657.182586:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790657.182605:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d83ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790657.182655:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253302656 00000100:00100000:0.0:1787790657.182659:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253302656 00000100:00100000:0.0:1787790657.182750:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787790657.182757:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45661c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:8456:x1874634253302656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790657.182892:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45661c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:8456:x1874634253302656:12345-0@lo:502:llog_process_th.0 Request processed in 135us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790657.182898:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787790657.183033:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db6a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8456:1874634253302656:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787790657.183051:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787790657.183393:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787790657.183410:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787790657.183419:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f1e00/0x70647b5fa977428f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774296 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790657.183434:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a542f1e00/0x70647b5fa977428f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774296 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790657.183443:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787790657.183446:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787790657.183448:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787790657.183473:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa977429d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790657.183480:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa977429d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790657.183489:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa977429d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790657.183503:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253302784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787790657.183531:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790657.183563:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a456cbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790657.183613:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253302784 00000100:00100000:2.0:1787790657.183617:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253302784 00000100:00100000:2.0:1787790657.183635:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787790657.183641:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45660050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253302784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790657.183650:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790657.183661:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a542f0e00/0x70647b5fa97742a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa977429d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790657.183678:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a542f0e00/0x70647b5fa97742a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa977429d expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790657.183687:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a542f0e00/0x70647b5fa97742a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa977429d expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790657.183695:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f0e00, rc 0) 00000100:00100000:2.0:1787790657.183749:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45660050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253302784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790657.183754:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787790657.183915:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253302784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790657.183927:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa977429d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97742a4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790657.183934:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa977429d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97742a4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790657.183972:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253302912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790657.183997:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790657.184034:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a456cbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790657.184072:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253302912 00000100:00100000:2.0:1787790657.184078:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253302912 00000100:00100000:2.0:1787790657.184097:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787790657.184102:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253302912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790657.184330:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253302912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790657.184336:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787790657.184475:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253302912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790657.184501:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253303040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790657.184534:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790657.184554:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a456cbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790657.184591:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253303040 00000100:00100000:2.0:1787790657.184599:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253303040 00000100:00100000:2.0:1787790657.184614:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787790657.184620:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253303040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790657.184765:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253303040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790657.184772:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787790657.184939:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253303040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790657.185149:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8457:1874634253303168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790657.185523:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790657.185535:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a456cb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790657.185577:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253303168 00000100:00100000:2.0:1787790657.185581:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253303168 00000100:00100000:2.0:1787790657.185599:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787790657.185604:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45662050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:8457:x1874634253303168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790657.185954:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45662050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:8457:x1874634253303168:12345-0@lo:502:llog_process_th.0 Request processed in 348us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790657.185960:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787790657.186113:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8457:1874634253303168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787790657.186137:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790657.186146:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790657.186149:0:8457:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787790657.186167:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787790657.186192:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8457:1874634253303296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790657.186226:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790657.186253:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a456cb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790657.186294:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253303296 00000100:00100000:0.0:1787790657.186304:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253303296 00000100:00100000:0.0:1787790657.186326:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787790657.186332:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45663050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:8457:x1874634253303296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790657.186477:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45663050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:8457:x1874634253303296:12345-0@lo:502:llog_process_th.0 Request processed in 145us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790657.186483:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787790657.186585:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8457:1874634253303296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787790657.186602:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790657.186607:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790657.186608:0:8457:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787790657.186611:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787790657.186784:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1787790657.186815:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787790657.186824:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa977429d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97742a4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790657.186833:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa977429d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97742a4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790657.186843:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787790657.186845:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff931a44ec4d28 from 1 10000000:01000000:0.0:1787790657.186848:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787790657.186870:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97742ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790657.186878:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97742ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790657.186887:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97742ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790657.186901:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c26a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253303424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787790657.186932:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790657.186960:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82240 going to sleep for 11 seconds 00000100:00100000:3.0:1787790657.187076:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253303424 00000100:00100000:3.0:1787790657.187081:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253303424 00000100:00100000:3.0:1787790657.187102:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787790657.187108:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45663850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253303424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790657.187123:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790657.187134:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a52848a00/0x70647b5fa97742b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97742ab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790657.187154:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a52848a00/0x70647b5fa97742b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97742ab expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790657.187170:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a52848a00/0x70647b5fa97742b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97742ab expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790657.187179:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a52848a00, rc 0) 00000100:00100000:3.0:1787790657.187214:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45663850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:5843:x1874634253303424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790657.187221:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787790657.188094:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c26a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253303424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790657.188112:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97742ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97742b2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790657.188122:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97742ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97742b2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790657.188177:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c26a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253303552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790657.188211:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790657.188236:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82240 going to sleep for 11 seconds 00000100:00100000:3.0:1787790657.188295:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253303552 00000100:00100000:3.0:1787790657.188300:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253303552 00000100:00100000:3.0:1787790657.188322:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787790657.188328:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45662850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:5843:x1874634253303552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790657.188542:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45662850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:5843:x1874634253303552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 213us (329us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787790657.188550:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787790657.188615:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c26a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253303552:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787790657.188638:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787790657.188644:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97742ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97742b2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790657.188652:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97742ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97742b2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790657.280071:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790657.600067:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253303680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790657.600092:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253304064:0@lo:400:kworker.0 00000100:00100000:0.0:1787790657.600202:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874634253303808:0@lo:400:kworker.0 00000100:00100000:3.0:1787790657.600240:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253303936:0@lo:400:kworker.0 00000100:00100000:1.0:1787790657.602285:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790657.602407:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253304064 00000100:00100000:1.0:1787790657.602416:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253304064 00000100:00100000:1.0:1787790657.602461:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787790657.602485:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253304064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790657.602565:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253304064:12345-0@lo:400:kworker.0 Request processed in 95us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790657.602572:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787790657.602615:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a45dbe940 x1874634253304064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790657.602640:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253304064:0@lo:400:kworker.0 00000100:00100000:2.0:1787790657.602956:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790657.603064:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1874634253304192:0@lo:400:kworker.0 00000100:00100000:1.0:1787790657.603306:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253303680 00000100:00100000:1.0:1787790657.603311:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253303680 00000100:00100000:1.0:1787790657.603359:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787790657.603368:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253303680:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790657.603378:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1787790657.603400:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787790657.603409:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253304320:0@lo:400:kworker.0 00000100:00100000:1.0:1787790657.603448:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253303680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790657.603449:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790657.603459:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787790657.603500:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253303808 00000100:00100000:1.0:1787790657.603504:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253303808 00000100:00100000:0.0:1787790657.603512:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253304320 00000100:00100000:0.0:1787790657.603517:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253304320 00000100:00100000:1.0:1787790657.603551:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787790657.603559:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c26a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874634253303808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790657.603564:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787790657.603575:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c26a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253304320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790657.603602:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c26a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874634253303808:12345-0@lo:400:kworker.0 Request processed in 44us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790657.603610:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787790657.603630:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c26a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253304320:12345-0@lo:400:kworker.0 Request processed in 56us (180us total) trans 0 rc 0/0 00000100:00080000:1.0:1787790657.603634:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787790657.603639:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787790657.603676:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874634253303808:0@lo:400:kworker.0 00010000:00080000:0.0:1787790657.603687:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a45dbf840 x1874634253304320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790657.603696:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253304320:0@lo:400:kworker.0 00000100:00100000:3.0:1787790657.604137:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790657.604218:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253303936 00000100:00100000:0.0:1787790657.604223:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253303936 00000100:00100000:0.0:1787790657.604264:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787790657.604271:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a810152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253303936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790657.604309:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a810152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253303936:12345-0@lo:400:kworker.0 Request processed in 39us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790657.604316:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787790657.604385:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253303936:0@lo:400:kworker.0 00000100:00080000:1.0:1787790657.605804:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790657.608631:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787790657.608782:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a81014b40 x1874634253303680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790673 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790657.608807:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253303680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790657.616477:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253304192 00000100:00100000:1.0:1787790657.616492:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253304192 00000100:00080000:0.0:1787790657.616763:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790657.616835:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787790657.616846:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874634253304192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790657.616958:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874634253304192:12345-0@lo:400:kworker.0 Request processed in 114us (8333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790657.616965:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787790657.617090:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1874634253304192:0@lo:400:kworker.0 00010000:00010000:0.0:1787790658.305224:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790659.338226:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790660.352240:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790660.525476:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790660.525576:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236498816 00000100:00100000:0.0:1787790660.525586:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236498816 00000100:00100000:0.0:1787790660.525638:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 164 00000100:00100000:0.0:1787790660.525648:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45661050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+8:5585:x1874634236498816:12345-192.168.201.25@tcp:101: 00010000:00010000:0.0:1787790660.525667:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790660.525687:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a40031600/0x70647b5fa97742b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496e98e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790660.525747:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a40031600/0x70647b5fa97742b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e98e expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790660.525757:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a40031600/0x70647b5fa97742b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e98e expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790660.525764:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a40031600, rc 0) 00000100:00100000:0.0:1787790660.525815:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45661050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+9:5585:x1874634236498816:12345-192.168.201.25@tcp:101: Request processed in 169us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790660.525822:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 164 00000100:00100000:2.0:1787790660.528403:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790660.530617:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236498944 00000100:00100000:3.0:1787790660.530770:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236498944 00000100:00100000:3.0:1787790660.530993:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 165 00000100:00100000:3.0:1787790660.531007:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45662450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+9:5585:x1874634236498944:12345-192.168.201.25@tcp:501: 00000100:00100000:3.0:1787790660.531464:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45662450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+9:5585:x1874634236498944:12345-192.168.201.25@tcp:501: Request processed in 458us (3070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790660.531474:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 165 00000100:00100000:1.0:1787790660.540035:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790660.541852:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236499072 00000100:00100000:0.0:1787790660.541872:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236499072 00000100:00100000:0.0:1787790660.541990:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 166 00000100:00100000:0.0:1787790660.542003:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+9:5585:x1874634236499072:12345-192.168.201.25@tcp:503: 00000100:00100000:0.0:1787790660.542652:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+9:5585:x1874634236499072:12345-192.168.201.25@tcp:503: Request processed in 648us (2622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790660.542663:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 166 00000100:00100000:0.0:1787790660.550205:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790660.550595:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236499200 00000100:00100000:3.0:1787790660.550608:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236499200 00000100:00100000:3.0:1787790660.550680:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 167 00000100:00100000:3.0:1787790660.550692:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+9:6076:x1874634236499200:12345-192.168.201.25@tcp:502: 00000100:00100000:3.0:1787790660.551079:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+9:6076:x1874634236499200:12345-192.168.201.25@tcp:502: Request processed in 388us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790660.551088:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 167 00000100:00100000:2.0:1787790660.553858:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790660.554183:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236499328 00000100:00100000:0.0:1787790660.554195:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236499328 00000100:00100000:0.0:1787790660.554265:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 168 00000100:00100000:0.0:1787790660.554276:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+9:6076:x1874634236499328:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787790660.555373:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+9:6076:x1874634236499328:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 1093us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790660.555384:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 168 00000100:00100000:0.0:1787790660.559552:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790660.559669:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236499456 00000100:00100000:1.0:1787790660.559682:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236499456 00000100:00100000:1.0:1787790660.559784:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 169 00000100:00100000:1.0:1787790660.559805:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+9:5585:x1874634236499456:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790660.559826:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790660.559848:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a45704200/0x70647b5fa97742c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496e995 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790660.559882:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a45704200/0x70647b5fa97742c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e995 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790660.559891:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a45704200/0x70647b5fa97742c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e995 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790660.559908:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45704200, rc 0) 00000100:00100000:1.0:1787790660.560477:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+10:5585:x1874634236499456:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 672us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790660.560487:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 169 00000100:00100000:2.0:1787790660.562713:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790660.563024:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236499584 00000100:00100000:0.0:1787790660.563036:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236499584 00000100:00100000:0.0:1787790660.563154:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 170 00000100:00100000:0.0:1787790660.563165:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+10:5585:x1874634236499584:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790660.563580:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+10:5585:x1874634236499584:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 416us (877us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787790660.563589:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 170 00010000:00010000:0.0:1787790661.376089:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790661.556149:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790661.556205:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790661.556320:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236499712 00000100:00100000:3.0:1787790661.556333:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236499712 00000100:00100000:3.0:1787790661.556504:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 171 00000100:00100000:3.0:1787790661.556516:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+10:2347:x1874634236499712:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790661.556609:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+10:2347:x1874634236499712:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 95us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790661.556617:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 171 00000100:00100000:0.0:1787790661.559097:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236499840 00000100:00100000:0.0:1787790661.559117:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236499840 00000100:00100000:0.0:1787790661.559212:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:0.0:1787790661.559224:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2347:x1874634236499840:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790661.559313:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2347:x1874634236499840:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 92us (3107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790661.559321:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00080000:0.0:1787790661.559348:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790661.563011:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790661.563902:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236500096 00000100:00100000:1.0:1787790661.563916:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236500096 00000100:00100000:1.0:1787790661.564024:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:1.0:1787790661.564036:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2347:x1874634236500096:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790661.564123:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2347:x1874634236500096:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 89us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790661.564133:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00080000:0.0:1787790661.564200:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787790661.564343:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790661.577169:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236499968 00000100:00100000:1.0:1787790661.577187:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236499968 00000100:00100000:1.0:1787790661.577271:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:1.0:1787790661.577302:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81016940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2346:x1874634236499968:12345-192.168.201.25@tcp:400:kworker.0 00000100:00080000:3.0:1787790661.577837:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790661.577971:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81016940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2346:x1874634236499968:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 668us (13625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790661.577981:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:3.0:1787790661.697021:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a810170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253304448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790661.697120:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790661.697220:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253304448 00000100:00100000:3.0:1787790661.697230:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253304448 00000100:00100000:3.0:1787790661.697302:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787790661.697313:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a810143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253304448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790661.697356:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790661.697408:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a810143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253304448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790661.697416:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787790661.697454:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787790661.697500:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a810170c0 x1874634253304448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790677 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790661.697523:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a810170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253304448:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1787790662.321175:0:8496:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc98129cf0 20000000:00000080:3.0:1787790662.321199:0:8496:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff931a7dafe400 uarg=0000000000000000 20000000:01000000:3.0:1787790662.321258:0:8496:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787790662.321266:0:8496:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787790662.321273:0:8496:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787790662.322587:0:8497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1787790662.322902:0:8496:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1787790662.331191:0:8496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1787790662.331271:0:8496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1787790662.331335:0:8496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1787790662.331356:0:8496:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787790662.331395:0:8496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff931a52849e00/0x70647b5fa97742c7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790662.331420:0:8496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a52849c00/0x70647b5fa977403c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9774035 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790662.331429:0:8496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a542f1800/0x70647b5fa977409e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9774097 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790662.331452:0:8496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a40030a00/0x70647b5fa9774169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9774162 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790662.331464:0:8496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a542f1200/0x70647b5fa9774226 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e95d expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790662.331537:0:8496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff931a52849e00/0x70647b5fa97742c7 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790662.331596:0:8496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a542f1200/0x70647b5fa9774226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e95d expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790662.331617:0:8496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff931a542f1200/0x70647b5fa9774226 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e95d expref: 9 pid: 5840 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790662.331635:0:8496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a810170c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1874634253304576:192.168.201.25@tcp:104: 00010000:00010000:3.0:1787790662.332015:0:8496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a40030a00/0x70647b5fa9774169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa9774162 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790662.332025:0:8496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a40030a00/0x70647b5fa9774169 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa9774162 expref: 18 pid: 5840 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790662.332035:0:8496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81015a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1874634253304704:0@lo:104: 00000100:00100000:3.0:1787790662.332087:0:8496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787790662.332135:0:8496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a542f1800/0x70647b5fa977409e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa9774097 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790662.332144:0:8496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a542f1800/0x70647b5fa977409e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa9774097 expref: 18 pid: 5841 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790662.332165:0:8496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81015680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1874634253304832:0@lo:104: 00000100:00100000:3.0:1787790662.332194:0:8496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790662.332248:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787790662.332261:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253304704 00000100:00100000:3.0:1787790662.332269:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253304704 00000100:00100000:3.0:1787790662.332315:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253304832 00000100:00100000:3.0:1787790662.332318:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253304832 00000100:00100000:3.0:1787790662.332335:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787790662.332357:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81015e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+4:8496:x1874634253304704:12345-0@lo:104: 00010000:00010000:3.0:1787790662.332373:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774162 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9774169 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790662.332439:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787790662.332446:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81015e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+4:8496:x1874634253304704:12345-0@lo:104: Request processed in 91us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790662.332455:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787790662.333089:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787790662.333100:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7dafc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+4:8496:x1874634253304832:12345-0@lo:104: 00010000:00010000:1.0:1787790662.333109:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9774097 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa977409e expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790662.333158:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787790662.333161:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7dafc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+4:8496:x1874634253304832:12345-0@lo:104: Request processed in 66us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790662.333166:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1787790662.333209:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787790662.333227:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774162 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9774169 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.333236:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41478800 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:2.0:1787790662.333240:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774162 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa9774169 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.333251:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774162 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa9774169 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790662.333259:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774162 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa9774169 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790662.333265:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787790662.333307:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774162 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774169 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.333314:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790662.333339:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774162 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774169 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.333347:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a41478800/0x70647b5fa9774162 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774169 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.333365:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790662.333368:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9774097 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa977409e expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.333374:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40031c00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:2.0:1787790662.333377:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9774097 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa977409e expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.334646:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9774097 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa977409e expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790662.334659:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9774097 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa977409e expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790662.334665:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787790662.334919:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9774097 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa977409e expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.334927:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790662.334964:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9774097 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa977409e expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.334973:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa9774097 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa977409e expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.334994:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790662.334997:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790662.334999:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790662.335030:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253304960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790662.335697:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790662.337894:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253305088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790662.337991:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790662.338061:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253304960 00000100:00100000:2.0:1787790662.338070:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253304960 00010000:00010000:2.0:1787790662.338119:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a40030a00/0x70647b5fa9774169 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9774162 expref: 19 pid: 5840 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790662.338178:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253305088 00000100:00100000:1.0:1787790662.338185:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253305088 00000100:00100000:2.0:1787790662.338190:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787790662.338203:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db69680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+20:3321:x1874634253304960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787790662.338210:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a542f1800/0x70647b5fa977409e lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9774097 expref: 20 pid: 5841 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790662.338228:0:5833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787790662.338237:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1787790662.338238:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790662.338256:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a40030a00/0x70647b5fa9774169 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9774162 expref: 20 pid: 5840 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.338269:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a40030a00/0x70647b5fa9774169 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa9774162 expref: 20 pid: 5840 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.338295:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790662.338340:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db69680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+20:3321:x1874634253304960:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (2644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790662.338348:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787790662.338371:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1787790662.338898:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790662.338986:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790662.339034:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236500224 00000100:00100000:1.0:1787790662.339039:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236500224 00010000:00010000:3.0:1787790662.339055:0:8496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a52849c00/0x70647b5fa977403c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa9774035 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790662.339060:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a542f1200/0x70647b5fa9774226 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e95d expref: 10 pid: 5840 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790662.339075:0:8496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a52849c00/0x70647b5fa977403c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa9774035 expref: 19 pid: 5841 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790662.339087:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:3.0:1787790662.339090:0:8496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81017840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1874634253305216:0@lo:104: 00000100:00100000:1.0:1787790662.339097:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81015e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b956aedb-a574-46fa-b700-b912aca9a68a+10:2349:x1874634236500224:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790662.339108:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790662.339124:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a542f1200/0x70647b5fa9774226 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e95d expref: 10 pid: 5840 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790662.339132:0:8496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790662.339143:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a542f1200/0x70647b5fa9774226 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e95d expref: 10 pid: 5840 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790662.339155:0:8496:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a46143300 going to sleep for 11 seconds 00010000:00010000:1.0:1787790662.339158:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790662.339219:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81015e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b956aedb-a574-46fa-b700-b912aca9a68a+10:2349:x1874634236500224:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 124us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790662.339227:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:1.0:1787790662.339243:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253305216 00000100:00100000:1.0:1787790662.339246:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253305216 00000100:00100000:1.0:1787790662.339263:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787790662.339267:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81016d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:8496:x1874634253305216:12345-0@lo:104: 00010000:00010000:1.0:1787790662.339278:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a41478e00/0x70647b5fa9774035 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa977403c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790662.339312:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787790662.339315:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81016d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:8496:x1874634253305216:12345-0@lo:104: Request processed in 49us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790662.339319:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787790662.340177:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db69a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3318:x1874634253305088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787790662.340193:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790662.340200:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a542f1800/0x70647b5fa977409e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9774097 expref: 19 pid: 5841 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.340211:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a542f1800/0x70647b5fa977409e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa9774097 expref: 19 pid: 5841 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.340236:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790662.340295:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db69a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3318:x1874634253305088:12345-0@lo:103:ldlm_bl.0 Request processed in 1917us (2303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790662.340303:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787790662.340395:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253305088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790662.340448:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253304960:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787790662.340467:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790662.340473:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a41478e00/0x70647b5fa9774035 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa977403c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.340482:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41478e00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:2.0:1787790662.340486:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a41478e00/0x70647b5fa9774035 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa977403c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.340495:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a41478e00/0x70647b5fa9774035 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa977403c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790662.340503:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a41478e00/0x70647b5fa9774035 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa977403c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790662.340509:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787790662.340549:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a41478e00/0x70647b5fa9774035 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa977403c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.340555:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790662.340574:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a41478e00/0x70647b5fa9774035 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa977403c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.340582:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a41478e00/0x70647b5fa9774035 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa977403c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.340602:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790662.340604:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790662.340605:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790662.340616:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253305344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790662.340654:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790662.340713:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253305344 00000100:00100000:2.0:1787790662.340719:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253305344 00010000:00010000:2.0:1787790662.340759:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a52849c00/0x70647b5fa977403c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9774035 expref: 19 pid: 5841 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790662.340782:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787790662.340789:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db692c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253305344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787790662.340797:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790662.340802:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a52849c00/0x70647b5fa977403c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9774035 expref: 19 pid: 5841 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.340810:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a52849c00/0x70647b5fa977403c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa9774035 expref: 19 pid: 5841 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.340823:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff931a52849e00/0x70647b5fa97742c7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.340832:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a52849e00/0x70647b5fa97742c7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.340850:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a52849e00/0x70647b5fa97742c7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.340857:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a52849e00/0x70647b5fa97742c7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.340863:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff931a52849e00/0x70647b5fa97742c7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.340869:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff931a52849e00/0x70647b5fa97742c7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.340881:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a52849e00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:2.0:1787790662.340886:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff931a52849e00/0x70647b5fa97742c7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.340893:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff931a52849e00/0x70647b5fa97742c7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.340902:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff931a52849e00/0x70647b5fa97742c7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.340922:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790662.340953:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db692c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253305344:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790662.340960:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787790662.340993:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253305344:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787790662.341303:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a542f1200/0x70647b5fa9774226 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e95d expref: 9 pid: 5840 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790662.341324:0:8496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a810170c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1874634253304576:192.168.201.25@tcp:104: 00010000:00010000:3.0:1787790662.341397:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a40030a00/0x70647b5fa9774169 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa9774162 expref: 18 pid: 5840 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790662.341406:0:8496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81015a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1874634253304704:0@lo:104: 00010000:00010000:3.0:1787790662.341417:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a542f1800/0x70647b5fa977409e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa9774097 expref: 17 pid: 5841 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790662.341426:0:8496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81015680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1874634253304832:0@lo:104: 00010000:00010000:3.0:1787790662.341439:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a52849c00/0x70647b5fa977403c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa9774035 expref: 16 pid: 5841 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790662.341446:0:8496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81017840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1874634253305216:0@lo:104: 00010000:00010000:3.0:1787790662.341467:0:8496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff931a52849e00/0x70647b5fa97742c7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790662.341477:0:8496:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff931a52849e00/0x70647b5fa97742c7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790662.341483:0:8496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff931a52849e00/0x70647b5fa97742c7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790662.341489:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a52849e00/0x70647b5fa97742c7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790662.400366:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790662.720248:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81017840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253305472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790662.720340:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790662.720583:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253305472 00000100:00100000:3.0:1787790662.720592:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253305472 00000100:00100000:3.0:1787790662.721061:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787790662.721069:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1787790662.721071:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253305472:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790662.721083:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1787790662.721115:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790662.721192:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253305472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790662.721199:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787790662.721555:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beb1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253305728:0@lo:400:kworker.0 00000100:00100000:2.0:1787790662.721599:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790662.721639:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787790662.721645:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beb1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253305856:0@lo:400:kworker.0 00000100:00100000:2.0:1787790662.721673:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790662.721709:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beb1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253305600:0@lo:400:kworker.0 00000100:00100000:2.0:1787790662.721757:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787790662.721858:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790662.721875:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253305856 00000100:00100000:1.0:1787790662.721882:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253305856 00000100:00100000:2.0:1787790662.721934:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787790662.721940:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1874634253305984:0@lo:400:kworker.0 00000100:00100000:2.0:1787790662.721974:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790662.722484:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787790662.722496:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53cce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253305856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790662.722559:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53cce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253305856:12345-0@lo:400:kworker.0 Request processed in 66us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790662.722578:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787790662.722634:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7beb1680 x1874634253305856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790662.722651:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beb1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253305856:0@lo:400:kworker.0 00000100:00100000:3.0:1787790662.722787:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253305728 00000100:00100000:3.0:1787790662.722792:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253305728 00000100:00100000:3.0:1787790662.722830:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253305600 00000100:00100000:3.0:1787790662.722832:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253305600 00000100:00100000:3.0:1787790662.722844:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787790662.722849:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253305728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790662.722889:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253305728:12345-0@lo:400:kworker.0 Request processed in 40us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790662.722893:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787790662.722915:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787790662.722921:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53cce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253305600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790662.722961:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53cce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253305600:12345-0@lo:400:kworker.0 Request processed in 40us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790662.722967:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1787790662.723253:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a81017840 x1874634253305472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790678 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790662.723275:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81017840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253305472:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787790662.723309:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790662.725116:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253305984 00000100:00100000:0.0:1787790662.725128:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253305984 00000100:00100000:2.0:1787790662.725137:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beb1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253305600:0@lo:400:kworker.0 00000100:00100000:0.0:1787790662.725193:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1787790662.725197:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790662.725214:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53cced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874634253305984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790662.725281:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53cced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874634253305984:12345-0@lo:400:kworker.0 Request processed in 70us (3308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790662.725286:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787790662.726021:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1874634253305984:0@lo:400:kworker.0 00000100:00100000:1.0:1787790662.726961:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beb1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253305728:0@lo:400:kworker.0 10000000:01000000:1.0:1787790663.423849:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787790663.423861:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9319447e6800 from 4 10000000:01000000:1.0:1787790663.423868:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787790663.423945:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97742ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790663.423961:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97742ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790663.423976:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97742ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790663.424012:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beb1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253306112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787790663.424114:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790663.424187:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47ced0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790663.424248:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253306112 00000100:00100000:3.0:1787790663.424257:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253306112 00000100:00100000:3.0:1787790663.424339:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787790663.424362:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:5843:x1874634253306112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790663.424380:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790663.424397:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a52849c00/0x70647b5fa97742d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97742ce expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790663.424443:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a52849c00/0x70647b5fa97742d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97742ce expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790663.424456:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a52849c00/0x70647b5fa97742d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97742ce expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790663.424467:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a52849c00, rc 0) 00000100:00100000:3.0:1787790663.424524:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253306112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790663.424532:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787790663.424813:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beb1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253306112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790663.424833:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97742ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97742d5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790663.424844:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97742ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97742d5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790663.424932:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beb1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253306240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790663.424965:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790663.424985:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47ced0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790663.425077:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253306240 00000100:00100000:2.0:1787790663.425082:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253306240 00000100:00100000:2.0:1787790663.425112:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787790663.425120:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253306240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790663.425576:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253306240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 455us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790663.425585:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787790663.425663:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beb1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253306240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790663.425702:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beb1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253306368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787790663.425785:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790663.425811:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47ced0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790663.425978:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253306368 00000100:00100000:3.0:1787790663.425984:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253306368 00000100:00100000:3.0:1787790663.426022:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787790663.426030:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253306368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790663.426212:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253306368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790663.426219:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787790663.426303:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beb1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253306368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790663.426700:0:8534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81015680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8534:1874634253306496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790663.426769:0:8534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790663.426791:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253306496 00000100:00100000:3.0:1787790663.426795:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253306496 00000100:00100000:3.0:1787790663.426814:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787790663.426820:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:8534:x1874634253306496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790663.426968:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:8534:x1874634253306496:12345-0@lo:502:llog_process_th.0 Request processed in 148us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790663.426981:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787790663.427011:0:8534:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a492ad540 going to sleep for 11 seconds 00000100:00100000:3.0:1787790663.427025:0:8534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81015680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8534:1874634253306496:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787790663.427049:0:8534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790663.427061:0:8534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790663.427063:0:8534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787790663.427074:0:8534:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9319447e6800 00000020:00000080:3.0:1787790663.427076:0:8534:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787790663.427171:0:8534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81015680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8534:1874634253306624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790663.427202:0:8534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790663.427219:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253306624 00000100:00100000:3.0:1787790663.427222:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253306624 00000100:00100000:3.0:1787790663.427238:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787790663.427244:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:8534:x1874634253306624:12345-0@lo:502:llog_process_th.0 00010000:00010000:2.0:1787790663.427556:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790663.427594:0:8534:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a492ad540 going to sleep for 11 seconds 00000100:00100000:3.0:1787790663.432971:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:8534:x1874634253306624:12345-0@lo:502:llog_process_th.0 Request processed in 5710us (5751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790663.432993:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787790663.442005:0:8534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81015680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8534:1874634253306624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787790663.454192:0:8534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790663.454215:0:8534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790663.454217:0:8534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787790663.454226:0:8534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787790663.454438:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787790663.454463:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787790663.454477:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97742ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97742d5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790663.454491:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97742ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97742d5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790663.454504:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787790663.454519:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff931a493ae800 from 4 10000000:01000000:2.0:1787790663.454523:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787790663.454576:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f0c00/0x70647b5fa97742dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790663.454585:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a542f0c00/0x70647b5fa97742dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790663.454598:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a542f0c00/0x70647b5fa97742dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790663.454633:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253306752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787790663.454749:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790663.454800:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4cbf5840 going to sleep for 11 seconds 00000100:00100000:2.0:1787790663.454826:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253306752 00000100:00100000:2.0:1787790663.454834:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253306752 00000100:00100000:2.0:1787790663.454887:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787790663.454908:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253306752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790663.454925:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790663.454942:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a542f1800/0x70647b5fa97742e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97742dc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790663.454971:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a542f1800/0x70647b5fa97742e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97742dc expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790663.454983:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a542f1800/0x70647b5fa97742e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97742dc expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790663.454994:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f1800, rc 0) 00000100:00100000:2.0:1787790663.455039:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253306752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790663.455054:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787790663.455115:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253306752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790663.455132:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a542f0c00/0x70647b5fa97742dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97742e3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790663.455143:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a542f0c00/0x70647b5fa97742dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97742e3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790663.455203:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253306880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790663.455231:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790663.455246:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d83a240 going to sleep for 11 seconds 00000100:00100000:2.0:1787790663.455260:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253306880 00000100:00100000:2.0:1787790663.455263:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253306880 00000100:00100000:2.0:1787790663.455284:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787790663.455292:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253306880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790663.455604:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253306880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790663.455611:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787790663.455642:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253306880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790663.455674:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253307008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790663.455719:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790663.455758:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d83a240 going to sleep for 11 seconds 00000100:00100000:2.0:1787790663.455771:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253307008 00000100:00100000:2.0:1787790663.455775:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253307008 00000100:00100000:2.0:1787790663.455798:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787790663.455811:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253307008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790663.455984:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253307008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790663.455992:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787790663.456031:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253307008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790663.456237:0:8537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8537:1874634253307136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790663.456272:0:8537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790663.456292:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253307136 00000100:00100000:2.0:1787790663.456296:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253307136 00000100:00100000:2.0:1787790663.456317:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787790663.456323:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:8537:x1874634253307136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790663.456448:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:8537:x1874634253307136:12345-0@lo:502:llog_process_th.0 Request processed in 125us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790663.456455:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787790663.456484:0:8537:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82840 going to sleep for 11 seconds 00000100:00100000:2.0:1787790663.456496:0:8537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8537:1874634253307136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787790663.456516:0:8537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790663.456527:0:8537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790663.456530:0:8537:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787790663.456537:0:8537:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff931a493ae800 00000020:00000080:2.0:1787790663.456539:0:8537:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787790663.456634:0:8537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8537:1874634253307264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790663.456667:0:8537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790663.456685:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253307264 00000100:00100000:2.0:1787790663.456689:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253307264 00000100:00100000:2.0:1787790663.456716:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787790663.456745:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:8537:x1874634253307264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790663.456848:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:8537:x1874634253307264:12345-0@lo:502:llog_process_th.0 Request processed in 125us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790663.456854:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787790663.456881:0:8537:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b64a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787790663.468770:0:8537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8537:1874634253307264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787790663.468855:0:8537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790663.468871:0:8537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790663.468874:0:8537:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787790663.468881:0:8537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787790663.469207:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787790663.469230:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787790663.469244:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f0c00/0x70647b5fa97742dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97742e3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790663.469257:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a542f0c00/0x70647b5fa97742dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97742e3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790663.469271:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787790663.469275:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff931a4977d000 from 4 10000000:01000000:3.0:1787790663.469290:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787790663.469463:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97742ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790663.469473:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97742ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790663.469484:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97742ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790663.469515:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81015a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253307392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787790663.469604:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790663.469657:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a42cdecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790663.471801:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253307392 00000100:00100000:2.0:1787790663.471821:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253307392 00000100:00100000:2.0:1787790663.471912:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787790663.471926:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253307392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790663.471951:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790663.471975:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a542f1200/0x70647b5fa97742f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97742ea expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790663.472009:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a542f1200/0x70647b5fa97742f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97742ea expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790663.472022:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a542f1200/0x70647b5fa97742f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97742ea expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790663.472033:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f1200, rc 0) 00000100:00100000:2.0:1787790663.472135:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:5843:x1874634253307392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (2530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790663.472155:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787790663.472228:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81015a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253307392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790663.472248:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97742ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97742f1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790663.472259:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97742ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97742f1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790663.472574:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253307520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790663.472615:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790663.473517:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b64a840 going to sleep for 11 seconds 00000100:00100000:3.0:1787790663.482481:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253307520 00000100:00100000:3.0:1787790663.482502:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253307520 00000100:00100000:3.0:1787790663.482591:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787790663.482604:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:5843:x1874634253307520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790663.483043:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:5843:x1874634253307520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 440us (10425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790663.483052:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787790663.490921:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253307520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790663.491011:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253307648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790663.491112:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790663.491169:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b64a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787790663.491197:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253307648 00000100:00100000:2.0:1787790663.491204:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253307648 00000100:00100000:2.0:1787790663.491261:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787790663.491270:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:5843:x1874634253307648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790663.493714:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:5843:x1874634253307648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2433us (2590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790663.494557:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787790663.508001:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253307648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790663.508630:0:8541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a810170c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8541:1874634253307776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790663.508819:0:8541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790663.508872:0:8541:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47ced0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790663.518381:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253307776 00000100:00100000:2.0:1787790663.518406:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253307776 00000100:00100000:2.0:1787790663.518596:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787790663.518618:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:8541:x1874634253307776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790663.519071:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:8541:x1874634253307776:12345-0@lo:502:llog_process_th.0 Request processed in 455us (10250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790663.519081:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787790663.519170:0:8541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a810170c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8541:1874634253307776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787790663.519217:0:8541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790663.519230:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790663.519233:0:8541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787790663.519242:0:8541:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff931a4977d000 00000020:00000080:2.0:1787790663.519244:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787790663.521942:0:8541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8541:1874634253307904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790663.522061:0:8541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790663.522114:0:8541:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82180 going to sleep for 11 seconds 00000100:00100000:0.0:1787790663.524135:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253307904 00000100:00100000:0.0:1787790663.524151:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253307904 00000100:00100000:0.0:1787790663.524229:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787790663.524240:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:8541:x1874634253307904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790663.527590:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:8541:x1874634253307904:12345-0@lo:502:llog_process_th.0 Request processed in 3339us (5516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790663.527609:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787790663.536657:0:8541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:8541:1874634253307904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787790663.536718:0:8541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790663.536749:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790663.536752:0:8541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787790663.536758:0:8541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787790663.541803:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787790663.541852:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787790663.541868:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97742ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97742f1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790663.541884:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97742ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97742f1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790663.668219:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790663.668710:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236500352 00000100:00100000:3.0:1787790663.668857:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236500352 00000100:00100000:2.0:1787790663.669122:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 187 00000100:00100000:2.0:1787790663.669153:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+9:5585:x1874634236500352:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790663.669178:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790663.669204:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a542f0200/0x70647b5fa97742f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496e99c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790663.669242:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a542f0200/0x70647b5fa97742f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e99c expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790663.669256:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a542f0200/0x70647b5fa97742f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e99c expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790663.669267:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f0200, rc 0) 00000100:00100000:2.0:1787790663.669349:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+10:5585:x1874634236500352:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 198us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790663.669366:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 187 00000100:00100000:1.0:1787790663.683996:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790663.684184:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236500480 00000100:00100000:2.0:1787790663.684197:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236500480 00000100:00100000:2.0:1787790663.684265:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 188 00000100:00100000:2.0:1787790663.684277:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+10:5585:x1874634236500480:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790663.684944:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+10:5585:x1874634236500480:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 661us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790663.684957:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 188 00000100:00100000:3.0:1787790663.693582:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790663.694418:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236500608 00000100:00100000:2.0:1787790663.694436:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236500608 00000100:00100000:2.0:1787790663.694530:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 189 00000100:00100000:2.0:1787790663.694544:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+10:5585:x1874634236500608:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790663.694927:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+10:5585:x1874634236500608:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 Request processed in 385us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790663.694944:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 189 00000100:00100000:3.0:1787790663.712840:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790663.713224:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236500736 00000100:00100000:0.0:1787790663.713238:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236500736 00000100:00100000:0.0:1787790663.713302:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 190 00000100:00100000:0.0:1787790663.713313:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+10:6133:x1874634236500736:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787790663.713652:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+10:6133:x1874634236500736:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 340us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790663.713662:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 190 00000100:00100000:1.0:1787790663.726398:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790663.729865:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236500864 00000100:00100000:3.0:1787790663.729900:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236500864 00000100:00100000:3.0:1787790663.730000:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 191 00000100:00100000:3.0:1787790663.730014:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+10:6133:x1874634236500864:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787790663.730405:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+10:6133:x1874634236500864:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 392us (4021us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790663.730415:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 191 00010000:00010000:0.0:1787790664.458305:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790665.472762:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790666.509870:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790666.677006:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790666.677064:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790666.677103:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790666.677141:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236500992 00000100:00100000:1.0:1787790666.677153:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236500992 00000100:00100000:3.0:1787790666.677183:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236501120 00000100:00100000:3.0:1787790666.677189:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236501120 00000100:00100000:1.0:1787790666.677218:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 192 00000100:00100000:1.0:1787790666.677231:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+10:2347:x1874634236500992:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790666.677249:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:3.0:1787790666.677260:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2346:x1874634236501120:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790666.677477:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2346:x1874634236501120:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 219us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790666.677486:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00080000:2.0:1787790666.677524:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790666.677671:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236501376 00000100:00100000:2.0:1787790666.677675:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236501376 00000100:00100000:2.0:1787790666.677719:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:2.0:1787790666.677745:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2346:x1874634236501376:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790666.677778:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2346:x1874634236501376:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 36us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790666.677785:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00080000:3.0:1787790666.677939:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790666.677991:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+10:2347:x1874634236500992:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 761us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790666.678000:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 192 00000100:00100000:2.0:1787790666.679349:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790666.679890:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236501248 00000100:00100000:1.0:1787790666.679900:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236501248 00000100:00100000:1.0:1787790666.679965:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:1.0:1787790666.679975:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ccf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2347:x1874634236501248:12345-192.168.201.25@tcp:400:kworker.0 00000100:00080000:3.0:1787790666.680074:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790666.680074:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ccf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2347:x1874634236501248:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 100us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790666.680086:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:0.0:1787790666.817563:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790666.817595:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253308032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787790666.817688:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790666.818511:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253308032 00000100:00100000:2.0:1787790666.818525:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253308032 00000100:00100000:2.0:1787790666.818627:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787790666.818639:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c26bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253308032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787790666.818699:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787790666.818799:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790666.818814:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c26bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253308032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790666.818823:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787790666.818889:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7c268000 x1874634253308032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790682 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790666.818912:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253308032:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787790667.522971:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790667.840159:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790667.840312:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81016580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253308160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790667.840413:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790667.842859:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253308672:0@lo:400:kworker.0 00000100:00100000:0.0:1787790667.842949:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790667.842999:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787790667.843006:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253308288:0@lo:400:kworker.0 00000100:00100000:0.0:1787790667.843039:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790667.843068:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1874634253308800:0@lo:400:kworker.0 00000100:00100000:0.0:1787790667.843095:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790667.843128:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c2692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253308416:0@lo:400:kworker.0 00000100:00100000:0.0:1787790667.843154:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790667.843172:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790667.843178:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c26b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253308544:0@lo:400:kworker.0 00000100:00100000:0.0:1787790667.843200:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790667.843237:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253308672 00000100:00100000:0.0:1787790667.843245:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253308672 00000100:00100000:0.0:1787790667.843308:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787790667.843319:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c26b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253308672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790667.843380:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c26b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253308672:12345-0@lo:400:kworker.0 Request processed in 62us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790667.843387:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787790667.843416:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253308288 00000100:00100000:0.0:1787790667.843420:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253308288 00000100:00100000:0.0:1787790667.844105:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787790667.844116:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3318:x1874634253308288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790667.844165:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3318:x1874634253308288:12345-0@lo:400:kworker.0 Request processed in 52us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790667.844175:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787790667.844223:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253308800 00000100:00100000:0.0:1787790667.844228:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253308800 00000100:00100000:0.0:1787790667.844269:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253308416 00000100:00100000:0.0:1787790667.844273:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253308416 00000100:00100000:0.0:1787790667.844284:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253308544 00000100:00100000:0.0:1787790667.844286:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253308544 00000100:00100000:0.0:1787790667.844303:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787790667.844308:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c269a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874634253308800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790667.844342:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c269a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874634253308800:12345-0@lo:400:kworker.0 Request processed in 34us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790667.844348:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787790667.844360:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787790667.844367:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253308416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790667.844400:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253308416:12345-0@lo:400:kworker.0 Request processed in 33us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790667.844406:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787790667.844418:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787790667.844425:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253308544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790667.846133:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253308544:12345-0@lo:400:kworker.0 Request processed in 1703us (2927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790667.846146:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787790667.846207:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790667.846261:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c26b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253308544:0@lo:400:kworker.0 00000100:00100000:0.0:1787790667.846277:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c2692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253308416:0@lo:400:kworker.0 00000100:00100000:0.0:1787790667.846336:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253308288:0@lo:400:kworker.0 00000100:00100000:0.0:1787790667.846349:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1874634253308800:0@lo:400:kworker.0 00010000:00080000:0.0:1787790667.846379:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7c268000 x1874634253308672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790667.846389:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253308672:0@lo:400:kworker.0 00000100:00100000:3.0:1787790667.846546:0:8510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253308160 00000100:00100000:3.0:1787790667.846555:0:8510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253308160 00000100:00100000:2.0:1787790667.846892:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787790667.846905:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c268b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253308160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787790667.846947:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787790667.847006:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c268b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253308160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (6594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790667.847013:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1787790667.847587:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787790667.847995:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a81016580 x1874634253308160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790667.848022:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81016580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253308160:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787790668.544935:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787790669.469148:0:8797:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1787790669.573872:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790670.591969:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790671.616927:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790671.792170:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790671.792223:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790671.792779:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236501504 00000100:00100000:0.0:1787790671.792789:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236501504 00000100:00100000:0.0:1787790671.792843:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 194 00000100:00100000:0.0:1787790671.792852:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+10:2348:x1874634236501504:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790671.792936:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+10:2348:x1874634236501504:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 84us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790671.792944:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 194 00000100:00100000:3.0:1787790671.796585:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236501632 00000100:00100000:3.0:1787790671.796599:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236501632 00000100:00100000:3.0:1787790671.797317:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:3.0:1787790671.797328:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2348:x1874634236501632:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790671.797409:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2348:x1874634236501632:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 83us (5185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790671.797693:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00080000:0.0:1787790671.797754:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790671.797868:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790671.799659:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790671.799711:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236501760 00000100:00100000:3.0:1787790671.799811:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236501760 00000100:00100000:3.0:1787790671.799871:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236501888 00000100:00100000:3.0:1787790671.799874:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236501888 00000100:00100000:3.0:1787790671.799898:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:3.0:1787790671.799906:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a810170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2345:x1874634236501760:12345-192.168.201.25@tcp:9:kworker.0 00000020:00000080:3.0:1787790671.799939:0:8297:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa9774234 00000100:00080000:3.0:1787790671.799950:0:8297:0:(import.c:65:import_set_state_nolock()) ffff93194645a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787790671.799987:0:8297:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:2.0:1787790671.801046:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787790671.801053:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790671.801708:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a810170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+2:2345:x1874634236501760:12345-192.168.201.25@tcp:9:kworker.0 Request processed in 1796us (3834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790671.801796:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:0.0:1787790671.801810:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81015a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2345:x1874634236501888:12345-192.168.201.25@tcp:9:kworker.0 00000020:00000080:0.0:1787790671.801837:0:6684:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa977423b 00000100:00080000:0.0:1787790671.801846:0:6684:0:(import.c:65:import_set_state_nolock()) ffff93194645f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787790671.801888:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787790671.802137:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81015a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+2:2345:x1874634236501888:12345-192.168.201.25@tcp:9:kworker.0 Request processed in 332us (2484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790671.802145:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:3.0:1787790671.802387:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00010000:00010000:3.0:1787790671.802512:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790671.803493:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790671.937673:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81015680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253308928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787790671.937816:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790671.938022:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253308928 00000100:00100000:2.0:1787790671.938029:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253308928 00000100:00100000:2.0:1787790671.938156:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787790671.938166:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d809680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253308928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787790671.938202:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787790671.938249:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d809680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253308928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790671.938256:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787790671.938287:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787790671.938326:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a81015680 x1874634253308928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790687 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790671.938344:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81015680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253308928:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787790672.645810:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790672.959972:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d80a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253309056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790672.960038:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790672.960115:0:8510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253309056 00000100:00100000:0.0:1787790672.960122:0:8510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253309056 00000100:00100000:0.0:1787790672.960173:0:8510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787790672.960182:0:8510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d80a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253309056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787790672.960216:0:8510:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787790672.960258:0:8510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d80a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253309056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790672.960265:0:8510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787790672.960296:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787790672.960326:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7d80a1c0 x1874634253309056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790672.960343:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d80a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253309056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790672.960583:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253309184:0@lo:400:kworker.0 00000100:00100000:0.0:1787790672.960614:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790672.960644:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931946937840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1874634253309696:0@lo:400:kworker.0 00000100:00100000:0.0:1787790672.960667:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790672.960687:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787790672.960692:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931946935a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253309312:0@lo:400:kworker.0 00000100:00100000:0.0:1787790672.960748:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790672.960778:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253309696 00000100:00100000:0.0:1787790672.960782:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253309696 00000100:00100000:0.0:1787790672.960812:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253309312 00000100:00100000:0.0:1787790672.960815:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253309312 00000100:00100000:0.0:1787790672.960835:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787790672.960841:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874634253309696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790672.960881:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874634253309696:12345-0@lo:400:kworker.0 Request processed in 41us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790672.960887:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787790672.960900:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787790672.960905:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d80ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253309312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790672.960930:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d80ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253309312:12345-0@lo:400:kworker.0 Request processed in 26us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790672.960936:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787790672.960964:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931946935e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253309440:0@lo:400:kworker.0 00000100:00100000:0.0:1787790672.960988:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790672.961004:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790672.961009:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931946935680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253309568:0@lo:400:kworker.0 00000100:00100000:0.0:1787790672.961030:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790672.961053:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253309568 00000100:00100000:0.0:1787790672.961056:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253309568 00000100:00100000:0.0:1787790672.961095:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787790672.961101:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d80b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253309568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790672.961131:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d80b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253309568:12345-0@lo:400:kworker.0 Request processed in 31us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790672.961137:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1787790672.961224:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787790672.961242:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931946935680 x1874634253309568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790672.961253:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931946935680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253309568:0@lo:400:kworker.0 00000100:00100000:0.0:1787790672.961269:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253309440 00000100:00100000:0.0:1787790672.961271:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253309440 00000100:00100000:2.0:1787790672.961381:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253309184 00000100:00100000:2.0:1787790672.961385:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253309184 00000100:00100000:2.0:1787790672.961413:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787790672.961419:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3318:x1874634253309184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790672.961450:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3318:x1874634253309184:12345-0@lo:400:kworker.0 Request processed in 31us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790672.961456:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787790672.961649:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787790672.961657:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d809e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253309440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790672.961690:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d809e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253309440:12345-0@lo:400:kworker.0 Request processed in 34us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790672.961696:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1787790672.961855:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790672.961875:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931946935e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253309440:0@lo:400:kworker.0 00000100:00100000:0.0:1787790672.961897:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931946935a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253309312:0@lo:400:kworker.0 00000100:00100000:0.0:1787790672.961905:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253309184:0@lo:400:kworker.0 00000100:00100000:0.0:1787790672.961915:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931946937840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1874634253309696:0@lo:400:kworker.0 00010000:00010000:0.0:1787790673.664365:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787790673.888055:0:9041:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing yml_node 00010000:00010000:3.0:1787790674.689966:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787790675.046194:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3e6e059d-f39a-42a8-9e93-fd30a950cc49 00000020:00000080:0.0:1787790675.046206:0:7630:0:(genops.c:885:class_export_put()) final put ffff93194645c000/3e6e059d-f39a-42a8-9e93-fd30a950cc49 00000020:00000080:3.0:1787790675.046314:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93194645c000/3e6e059d-f39a-42a8-9e93-fd30a950cc49 for lustre-OST0001 00000020:00000080:3.0:1787790675.046369:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93194645f800 for lustre-OST0001 00010000:00010000:0.0:1787790675.711963:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787790676.581541:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3e6e059d-f39a-42a8-9e93-fd30a950cc49 00000020:00000080:3.0:1787790676.581551:0:6709:0:(genops.c:885:class_export_put()) final put ffff931946458800/3e6e059d-f39a-42a8-9e93-fd30a950cc49 00000020:00000080:1.0:1787790676.581622:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff931946458800/3e6e059d-f39a-42a8-9e93-fd30a950cc49 for lustre-OST0000 00000020:00000080:1.0:1787790676.581685:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93194645a000 for lustre-OST0000 00010000:00010000:3.0:1787790676.736656:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790676.909923:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790676.909985:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790676.911352:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236502144 00000100:00100000:0.0:1787790676.911365:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236502144 00000100:00100000:0.0:1787790676.911465:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:0.0:1787790676.911477:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81017840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2349:x1874634236502144:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790676.911556:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81017840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2349:x1874634236502144:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 83us (1645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790676.911582:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00080000:2.0:1787790676.911805:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790676.914988:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236502016 00000100:00100000:1.0:1787790676.915002:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236502016 00000100:00100000:1.0:1787790676.915121:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 196 00000100:00100000:1.0:1787790676.915132:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+10:2349:x1874634236502016:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790676.915235:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+10:2349:x1874634236502016:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 105us (5249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790676.915243:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 196 00000100:00100000:0.0:1787790677.062284:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253309824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787790677.062360:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790677.062594:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253309824 00000100:00100000:2.0:1787790677.062601:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253309824 00000100:00100000:2.0:1787790677.062674:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787790677.062684:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d808f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253309824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787790677.062719:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787790677.062793:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d808f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253309824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790677.062802:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1787790677.062961:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787790677.063024:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a81014b40 x1874634253309824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790677.063042:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253309824:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787790677.762274:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790678.081337:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beb3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253309952:0@lo:400:kworker.0 00000100:00100000:1.0:1787790678.081414:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790678.081460:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1874634253310464:0@lo:400:kworker.0 00000100:00100000:1.0:1787790678.081487:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790678.081516:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787790678.081522:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253310080:0@lo:400:kworker.0 00000100:00100000:1.0:1787790678.081542:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790678.081561:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beb2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253310592:0@lo:400:kworker.0 00000100:00100000:1.0:1787790678.081585:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790678.081615:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beb0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253310208:0@lo:400:kworker.0 00000100:00100000:1.0:1787790678.081653:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790678.081674:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790678.081679:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beb12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253310336:0@lo:400:kworker.0 00000100:00100000:1.0:1787790678.081700:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790678.081770:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253309952 00000100:00100000:1.0:1787790678.081778:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253309952 00000100:00100000:1.0:1787790678.081831:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787790678.081840:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3320:x1874634253309952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790678.081892:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3320:x1874634253309952:12345-0@lo:400:kworker.0 Request processed in 53us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790678.081900:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787790678.081930:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253310464 00000100:00100000:1.0:1787790678.081934:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253310464 00000100:00100000:1.0:1787790678.081968:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253310080 00000100:00100000:1.0:1787790678.081971:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253310080 00000100:00100000:1.0:1787790678.081982:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253310208 00000100:00100000:1.0:1787790678.082164:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253310208 00000100:00100000:1.0:1787790678.082188:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787790678.082194:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874634253310464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790678.082229:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874634253310464:12345-0@lo:400:kworker.0 Request processed in 36us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790678.082235:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787790678.082247:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787790678.082253:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253310080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790678.082278:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253310080:12345-0@lo:400:kworker.0 Request processed in 26us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790678.082284:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787790678.082294:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787790678.082300:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253310208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790678.082408:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253310208:12345-0@lo:400:kworker.0 Request processed in 107us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790678.082414:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787790678.082437:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253310592 00000100:00100000:1.0:1787790678.082441:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253310592 00000100:00100000:1.0:1787790678.082467:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253310336 00000100:00100000:1.0:1787790678.082471:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253310336 00000100:00100000:1.0:1787790678.082491:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787790678.082498:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253310592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790678.082530:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253310592:12345-0@lo:400:kworker.0 Request processed in 32us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790678.082536:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787790678.082547:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787790678.082552:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253310336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790678.082589:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253310336:12345-0@lo:400:kworker.0 Request processed in 37us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790678.082595:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787790678.082623:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787790678.082628:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790678.082760:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253310080:0@lo:400:kworker.0 00010000:00080000:1.0:1787790678.082776:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7beb2940 x1874634253310592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790678.082787:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beb2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253310592:0@lo:400:kworker.0 00000100:00100000:1.0:1787790678.082797:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beb3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253309952:0@lo:400:kworker.0 00000100:00100000:1.0:1787790678.082808:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1874634253310464:0@lo:400:kworker.0 00000100:00100000:3.0:1787790678.084501:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787790678.084519:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253310720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790678.084827:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790678.084870:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253310720 00000100:00100000:3.0:1787790678.084884:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253310720 00000100:00100000:3.0:1787790678.084921:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787790678.084928:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81017c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253310720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787790678.084961:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790678.085002:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81017c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253310720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790678.085009:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787790678.085045:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a81014000 x1874634253310720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790694 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790678.085075:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253310720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790678.086096:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beb0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253310208:0@lo:400:kworker.0 00010000:00080000:0.0:1787790678.086121:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7beb12c0 x1874634253310336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790678.086132:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beb12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253310336:0@lo:400:kworker.0 00000001:02000400:3.0:1787790678.728324:0:9236:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.50 00010000:00010000:0.0:1787790678.785174:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790679.808432:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790680.835652:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787790681.228709:0:9333:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.50 00010000:00010000:0.0:1787790681.856544:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790682.039206:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790682.039260:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790682.039336:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236502272 00000100:00100000:1.0:1787790682.039347:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236502272 00000100:00100000:1.0:1787790682.039399:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 198 00000100:00100000:1.0:1787790682.039410:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+10:2348:x1874634236502272:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790682.039485:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+10:2348:x1874634236502272:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 77us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790682.039493:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 198 00000100:00100000:3.0:1787790682.040409:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236502400 00000100:00100000:3.0:1787790682.040417:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236502400 00000100:00100000:0.0:1787790682.040720:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:0.0:1787790682.040766:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931946936d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2349:x1874634236502400:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790682.040834:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931946936d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2349:x1874634236502400:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 73us (1573us total) trans 0 rc 0/0 00000100:00080000:1.0:1787790682.041048:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790682.041447:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:1.0:1787790682.177310:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beb3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253310848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790682.177383:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790682.177460:0:8510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253310848 00000100:00100000:1.0:1787790682.177468:0:8510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253310848 00000100:00100000:1.0:1787790682.177522:0:8510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787790682.177542:0:8510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253310848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787790682.177587:0:8510:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787790682.177634:0:8510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253310848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790682.177641:0:8510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787790682.177661:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787790682.177689:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7beb3c00 x1874634253310848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790698 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790682.177709:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beb3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253310848:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787790682.879983:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790683.202098:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253310976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790683.202206:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790683.202315:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253310976 00000100:00100000:3.0:1787790683.202325:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253310976 00000100:00100000:3.0:1787790683.205366:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787790683.205385:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81016580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253310976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787790683.205437:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790683.205543:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81016580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253310976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (3338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790683.205566:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787790683.207231:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9319469361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253311104:0@lo:400:kworker.0 00000100:00100000:1.0:1787790683.207332:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787790683.207425:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787790683.207494:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253311104 00000100:00100000:3.0:1787790683.207505:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253311104 00000100:00100000:3.0:1787790683.207570:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787790683.207580:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3321:x1874634253311104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790683.207656:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3321:x1874634253311104:12345-0@lo:400:kworker.0 Request processed in 77us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790683.207664:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787790683.207793:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9319469361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253311104:0@lo:400:kworker.0 00010000:00080000:3.0:1787790683.207902:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7beb3480 x1874634253310976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790699 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790683.207937:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253310976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790683.209564:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931946937c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1874634253311616:0@lo:400:kworker.0 00000100:00100000:2.0:1787790683.209645:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790683.209690:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787790683.209696:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931946934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253311488:0@lo:400:kworker.0 00000100:00100000:2.0:1787790683.209751:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790683.209784:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253311616 00000100:00100000:2.0:1787790683.209792:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253311616 00000100:00100000:2.0:1787790683.209858:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787790683.209868:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931946934b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874634253311616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790683.209937:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931946934b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874634253311616:12345-0@lo:400:kworker.0 Request processed in 71us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790683.209955:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787790683.209984:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253311488 00000100:00100000:2.0:1787790683.209988:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253311488 00000100:00100000:2.0:1787790683.210027:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787790683.210035:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931946934f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253311488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790683.210067:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931946934f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253311488:12345-0@lo:400:kworker.0 Request processed in 34us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790683.210073:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1787790683.210089:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787790683.210121:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931946934000 x1874634253311488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790683.210135:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931946934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253311488:0@lo:400:kworker.0 00000100:00100000:2.0:1787790683.210147:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931946937c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1874634253311616:0@lo:400:kworker.0 00000100:00100000:3.0:1787790683.210368:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931946934780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1874634253311360:0@lo:400:kworker.0 00000100:00100000:3.0:1787790683.210404:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790683.210436:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787790683.210443:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931946936580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874634253311232:0@lo:400:kworker.0 00000100:00100000:3.0:1787790683.210466:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790683.210644:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253311360 00000100:00100000:0.0:1787790683.210649:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253311360 00000100:00100000:0.0:1787790683.210695:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253311232 00000100:00100000:0.0:1787790683.210698:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253311232 00000100:00100000:0.0:1787790683.210715:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787790683.210744:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81015680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874634253311360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790683.210799:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81015680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874634253311360:12345-0@lo:400:kworker.0 Request processed in 77us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790683.210806:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787790683.210821:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787790683.210828:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a810161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874634253311232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790683.210856:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a810161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874634253311232:12345-0@lo:400:kworker.0 Request processed in 29us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790683.210861:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787790683.210895:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931946936580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874634253311232:0@lo:400:kworker.0 00000100:00100000:0.0:1787790683.211069:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931946934780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1874634253311360:0@lo:400:kworker.0 00000100:00080000:3.0:1787790683.211134:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787790683.889614:0:9430:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.50 00010000:00010000:0.0:1787790683.910830:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790684.933969:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787790685.653693:0:9480:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Aug 26 20:31:24 EDT 2026 00010000:00010000:0.0:1787790685.951976:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790686.979230:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790687.154906:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790687.154979:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790687.155018:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236502528 00000100:00100000:3.0:1787790687.155027:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236502656 00000100:00100000:3.0:1787790687.155030:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236502656 00000100:00100000:0.0:1787790687.155030:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236502528 00000100:00100000:0.0:1787790687.155095:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 200 00000100:00100000:0.0:1787790687.155107:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+10:2346:x1874634236502528:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790687.155162:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:3.0:1787790687.155168:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d80b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2346:x1874634236502656:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790687.155201:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+10:2346:x1874634236502528:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 95us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790687.155209:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 200 00000100:00100000:3.0:1787790687.155269:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d80b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2346:x1874634236502656:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 100us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790687.155277:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00080000:3.0:1787790687.157149:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790687.296966:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253311744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790687.297162:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790687.297383:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253311744 00000100:00100000:1.0:1787790687.297394:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253311744 00000100:00100000:1.0:1787790687.297485:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787790687.297497:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81014b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253311744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787790687.297543:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787790687.297603:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81014b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253311744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790687.297610:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787790687.297657:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7beb0b40 x1874634253311744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790687.297680:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253311744:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787790687.297810:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787790688.010500:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790688.321796:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9319469370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1874634253312128:0@lo:400:kworker.0 00000100:00100000:2.0:1787790688.321908:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790688.322047:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931946937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253311872:0@lo:400:kworker.0 00000100:00100000:1.0:1787790688.322366:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9319469343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253312256:0@lo:400:kworker.0 00000100:00100000:0.0:1787790688.322457:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790688.322547:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9319469352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253312384:0@lo:400:kworker.0 00000100:00100000:0.0:1787790688.322576:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790688.322625:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931946936940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253312000:0@lo:400:kworker.0 00000100:00100000:0.0:1787790688.322653:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790688.322673:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931946934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253312512:0@lo:400:kworker.0 00000100:00100000:0.0:1787790688.322702:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790688.322778:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253312128 00000100:00100000:0.0:1787790688.322788:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253312128 00000100:00100000:0.0:1787790688.322851:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253312384 00000100:00100000:0.0:1787790688.322854:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253312384 00000100:00100000:0.0:1787790688.322871:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253312000 00000100:00100000:0.0:1787790688.322886:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253312000 00000100:00100000:0.0:1787790688.322907:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787790688.322918:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931946937c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874634253312128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790688.322991:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931946937c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874634253312128:12345-0@lo:400:kworker.0 Request processed in 74us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790688.323000:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787790688.323033:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787790688.323041:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d808b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253312384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790688.323078:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d808b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253312384:12345-0@lo:400:kworker.0 Request processed in 38us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790688.323085:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787790688.323098:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787790688.323105:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253312000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790688.323138:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253312000:12345-0@lo:400:kworker.0 Request processed in 34us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790688.323156:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787790688.323177:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253312512 00000100:00100000:0.0:1787790688.323181:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253312512 00000100:00100000:0.0:1787790688.323212:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787790688.323220:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d80a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253312512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790688.323254:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d80a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253312512:12345-0@lo:400:kworker.0 Request processed in 36us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790688.323261:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787790688.323307:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931946936940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253312000:0@lo:400:kworker.0 00010000:00080000:0.0:1787790688.323324:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931946934000 x1874634253312512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790688.323336:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931946934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253312512:0@lo:400:kworker.0 00000100:00100000:0.0:1787790688.323371:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9319469352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253312384:0@lo:400:kworker.0 00000100:00100000:3.0:1787790688.325206:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253311872 00000100:00100000:3.0:1787790688.325223:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253311872 00000100:00100000:3.0:1787790688.325319:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787790688.325330:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253311872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790688.325432:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253311872:12345-0@lo:400:kworker.0 Request processed in 104us (2974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790688.325439:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:3.0:1787790688.325505:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787790688.325514:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790688.325562:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931946937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253311872:0@lo:400:kworker.0 00000100:00100000:1.0:1787790688.326228:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790688.326416:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790688.326433:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beb1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253312640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790688.326493:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790688.327138:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253312256 00000100:00100000:3.0:1787790688.327147:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253312256 00000100:00100000:3.0:1787790688.327207:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787790688.327216:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253312256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790688.327287:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253312256:12345-0@lo:400:kworker.0 Request processed in 72us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790688.327294:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1787790688.327339:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9319469343c0 x1874634253312256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790688.327354:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9319469343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253312256:0@lo:400:kworker.0 00000100:00100000:1.0:1787790688.327516:0:8510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253312640 00000100:00100000:1.0:1787790688.327521:0:8510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253312640 00000100:00100000:1.0:1787790688.327556:0:8510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787790688.327563:0:8510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d809a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253312640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787790688.327601:0:8510:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787790688.327638:0:8510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d809a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253312640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790688.327644:0:8510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787790688.327708:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7beb1a40 x1874634253312640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790688.327754:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beb1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253312640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790688.328107:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9319469370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1874634253312128:0@lo:400:kworker.0 00010000:00010000:0.0:1787790689.027039:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790690.049443:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790691.075129:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790692.101545:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790692.271836:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790692.271882:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790692.273325:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236502784 00000100:00100000:0.0:1787790692.273353:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236502784 00000100:00100000:0.0:1787790692.273451:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 202 00000100:00100000:0.0:1787790692.273463:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+10:2347:x1874634236502784:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790692.273580:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+10:2347:x1874634236502784:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 120us (1761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790692.273588:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 202 00000100:00100000:0.0:1787790692.273634:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236502912 00000100:00100000:0.0:1787790692.273638:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236502912 00000100:00100000:0.0:1787790692.273686:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00100000:0.0:1787790692.273694:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9319469370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2347:x1874634236502912:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790692.273764:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9319469370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2347:x1874634236502912:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 71us (1882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790692.273772:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00080000:0.0:1787790692.273940:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790692.421612:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787790692.421638:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d8083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253312768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787790692.421717:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790692.421840:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253312768 00000100:00100000:1.0:1787790692.421848:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253312768 00000100:00100000:1.0:1787790692.421986:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787790692.421994:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931946934780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253312768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787790692.422033:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787790692.422079:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931946934780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253312768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790692.422085:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1787790692.427068:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7d8083c0 x1874634253312768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790692.427099:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d8083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253312768:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787790692.428107:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787790693.119901:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790693.443446:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d808780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253312896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790693.443518:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790693.443588:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253312896 00000100:00100000:0.0:1787790693.443595:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253312896 00000100:00100000:0.0:1787790693.443644:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787790693.443652:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d80bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253312896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787790693.443685:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787790693.446323:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d80bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253312896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790693.446339:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787790693.446391:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931946935a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253313408:0@lo:400:kworker.0 00000100:00100000:0.0:1787790693.446455:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787790693.446502:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7d808780 x1874634253312896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790693.446524:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d808780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253312896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790693.446547:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790693.446552:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931946937840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1874634253313280:0@lo:400:kworker.0 00000100:00100000:0.0:1787790693.446574:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790693.446600:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931946936580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253313024:0@lo:400:kworker.0 00000100:00100000:0.0:1787790693.446625:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790693.446648:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790693.446653:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9319469361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253313152:0@lo:400:kworker.0 00000100:00100000:0.0:1787790693.446671:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790693.446695:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253313408 00000100:00100000:0.0:1787790693.446700:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253313408 00000100:00100000:0.0:1787790693.446760:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787790693.446769:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253313408:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787790693.447341:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787790693.447351:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787790693.447363:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931946935e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1874634253313536:0@lo:400:kworker.0 00000100:00100000:0.0:1787790693.449008:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253313408:12345-0@lo:400:kworker.0 Request processed in 2231us (2543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790693.449021:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787790693.449061:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253313280 00000100:00100000:0.0:1787790693.449069:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253313280 00000100:00100000:0.0:1787790693.449110:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253313152 00000100:00100000:0.0:1787790693.449112:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253313152 00000100:00100000:0.0:1787790693.449129:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787790693.449136:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874634253313280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790693.452470:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787790693.452506:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931946935a40 x1874634253313408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790693.452523:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931946935a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253313408:0@lo:400:kworker.0 00000100:00100000:1.0:1787790693.452557:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253313536 00000100:00100000:1.0:1787790693.452562:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253313536 00000100:00100000:1.0:1787790693.452604:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787790693.452613:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ccc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253313152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790693.452670:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ccc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253313152:12345-0@lo:400:kworker.0 Request processed in 58us (5997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790693.452677:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787790693.452694:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787790693.452699:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931946935680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874634253313536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790693.453103:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874634253313280:12345-0@lo:400:kworker.0 Request processed in 3965us (6526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790693.453116:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787790693.453149:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9319469361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253313152:0@lo:400:kworker.0 00000100:00080000:0.0:1787790693.453168:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790693.453476:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931946935680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874634253313536:12345-0@lo:400:kworker.0 Request processed in 775us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790693.453483:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787790693.453505:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253313024 00000100:00100000:1.0:1787790693.453509:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253313024 00000100:00100000:1.0:1787790693.453539:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787790693.453546:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3320:x1874634253313024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790693.453582:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3320:x1874634253313024:12345-0@lo:400:kworker.0 Request processed in 36us (6956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790693.453588:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787790693.453687:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931946937840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1874634253313280:0@lo:400:kworker.0 00000100:00100000:1.0:1787790693.453708:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931946936580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253313024:0@lo:400:kworker.0 00000100:00100000:2.0:1787790693.465068:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931946935e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1874634253313536:0@lo:400:kworker.0 00010000:00010000:0.0:1787790694.144909:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790695.167958:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790696.193092:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790697.219857:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790697.391976:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790697.392018:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790697.392105:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236503168 00000100:00100000:1.0:1787790697.392115:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236503168 00000100:00100000:1.0:1787790697.392187:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:1.0:1787790697.392196:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c268780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2347:x1874634236503168:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790697.392266:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c268780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2347:x1874634236503168:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 72us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790697.392274:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:3.0:1787790697.392941:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236503040 00000100:00100000:3.0:1787790697.392948:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236503040 00000100:00100000:3.0:1787790697.392978:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 204 00000100:00100000:3.0:1787790697.392985:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46532850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+10:2347:x1874634236503040:12345-192.168.201.25@tcp:400:kworker.0 00000100:00080000:0.0:1787790697.393105:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790697.394871:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46532850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+10:2347:x1874634236503040:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 1875us (2894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790697.394885:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 204 00000100:00100000:1.0:1787790697.536493:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787790697.536525:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253313664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790697.536595:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790697.543092:0:8510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253313664 00000100:00100000:3.0:1787790697.543104:0:8510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253313664 00000100:00080000:0.0:1787790697.543185:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790697.543200:0:8510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787790697.543211:0:8510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253313664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790697.543249:0:8510:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790697.543346:0:8510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253313664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (6750us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790697.543354:0:8510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787790697.543458:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7c268f00 x1874634253313664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790697.543479:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253313664:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787790698.241617:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790698.559997:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787790698.560035:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c2692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253313792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790698.560109:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790698.560316:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253313792 00000100:00100000:0.0:1787790698.560324:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253313792 00000100:00100000:0.0:1787790698.560393:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787790698.560403:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253313792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787790698.560441:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787790698.560488:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253313792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790698.560495:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787790698.560535:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7c2692c0 x1874634253313792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790698.560554:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c2692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253313792:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787790698.560860:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787790698.562510:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1874634253314176:0@lo:400:kworker.0 00000100:00100000:3.0:1787790698.562568:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790698.562614:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787790698.562621:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253314048:0@lo:400:kworker.0 00000100:00100000:3.0:1787790698.562644:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790698.562676:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253314176 00000100:00100000:3.0:1787790698.562682:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253314176 00000100:00100000:3.0:1787790698.562771:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253314048 00000100:00100000:3.0:1787790698.562775:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253314048 00000100:00100000:3.0:1787790698.562797:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787790698.562805:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53f052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874634253314176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790698.562865:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53f052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874634253314176:12345-0@lo:400:kworker.0 Request processed in 60us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790698.562873:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787790698.562963:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787790698.562985:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53f061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253314048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790698.563017:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53f061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253314048:12345-0@lo:400:kworker.0 Request processed in 34us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790698.563023:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1787790698.563043:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790698.563171:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253314048:0@lo:400:kworker.0 00000100:00100000:3.0:1787790698.563180:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1874634253314176:0@lo:400:kworker.0 00000100:00100000:2.0:1787790698.563477:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253314304:0@lo:400:kworker.0 00000100:00100000:2.0:1787790698.563512:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790698.563543:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787790698.563548:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81014780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253313920:0@lo:400:kworker.0 00000100:00100000:2.0:1787790698.563572:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790698.563606:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1874634253314432:0@lo:400:kworker.0 00000100:00100000:2.0:1787790698.563627:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790698.563886:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253314304 00000100:00100000:3.0:1787790698.563900:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253314304 00000100:00100000:1.0:1787790698.563917:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253314432 00000100:00100000:1.0:1787790698.563922:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253314432 00000100:00100000:1.0:1787790698.563955:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787790698.563962:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931946935a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874634253314432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790698.563975:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787790698.563982:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9319469361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253314304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790698.564065:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253313920 00000100:00100000:0.0:1787790698.564069:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253313920 00000100:00100000:0.0:1787790698.564100:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787790698.564107:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46533850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3318:x1874634253313920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790698.564851:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46533850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3318:x1874634253313920:12345-0@lo:400:kworker.0 Request processed in 744us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790698.564852:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9319469361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253314304:12345-0@lo:400:kworker.0 Request processed in 871us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790698.564860:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787790698.564860:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:3.0:1787790698.564884:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790698.565025:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81014780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253313920:0@lo:400:kworker.0 00000100:00100000:2.0:1787790698.565038:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1874634253314432:0@lo:400:kworker.0 00010000:00080000:2.0:1787790698.565062:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a53ee9a40 x1874634253314304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790698.565072:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253314304:0@lo:400:kworker.0 00000100:00100000:1.0:1787790698.565591:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931946935a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874634253314432:12345-0@lo:400:kworker.0 Request processed in 1626us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790698.565599:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:1.0:1787790699.264079:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787790699.686046:0:10111:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 20:31:38 (1787790698) === 00000100:00100000:0.0:1787790700.042684:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790700.043245:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236503296 00000100:00100000:1.0:1787790700.043267:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236503296 00000100:00100000:1.0:1787790700.043339:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 206 00000100:00100000:1.0:1787790700.043350:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+10:8134:x1874634236503296:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787790700.043373:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790700.043395:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a45705e00/0x70647b5fa97742ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496e9a3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790700.043454:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a45705e00/0x70647b5fa97742ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9a3 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790700.043464:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a45705e00/0x70647b5fa97742ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9a3 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790700.043472:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45705e00, rc 0) 00000100:00100000:1.0:1787790700.043541:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+11:8134:x1874634236503296:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 194us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790700.043547:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 206 00000100:00100000:3.0:1787790700.054554:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790700.054775:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236503424 00000100:00100000:0.0:1787790700.054788:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236503424 00000100:00100000:0.0:1787790700.054855:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 207 00000100:00100000:0.0:1787790700.054864:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+11:8134:x1874634236503424:12345-192.168.201.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787790700.055244:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+11:8134:x1874634236503424:12345-192.168.201.25@tcp:501:mount.lustre.0 Request processed in 380us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790700.055252:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 207 00000100:00100000:2.0:1787790700.058453:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790700.058588:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236503552 00000100:00100000:0.0:1787790700.058600:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236503552 00000100:00100000:0.0:1787790700.058709:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 208 00000100:00100000:0.0:1787790700.058719:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46533450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+11:8134:x1874634236503552:12345-192.168.201.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787790700.059083:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46533450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+11:8134:x1874634236503552:12345-192.168.201.25@tcp:503:mount.lustre.0 Request processed in 364us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790700.059092:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 208 00000100:00100000:2.0:1787790700.063911:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790700.064035:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236503680 00000100:00100000:1.0:1787790700.064049:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236503680 00000100:00100000:1.0:1787790700.064229:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 209 00000100:00100000:1.0:1787790700.064241:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46533c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+11:8138:x1874634236503680:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787790700.064631:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46533c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+11:8138:x1874634236503680:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 391us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790700.064641:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 209 00000100:00100000:1.0:1787790700.078512:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790700.081196:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236503808 00000100:00100000:0.0:1787790700.081218:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236503808 00000100:00100000:0.0:1787790700.082002:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 210 00000100:00100000:0.0:1787790700.083088:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46531450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+11:8138:x1874634236503808:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787790700.083569:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46531450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+11:8138:x1874634236503808:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 508us (5070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790700.088116:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 210 00000100:00100000:2.0:1787790700.092219:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790700.092304:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236503936 00000100:00100000:1.0:1787790700.092968:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236503936 00000100:00100000:1.0:1787790700.093083:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 211 00000100:00100000:1.0:1787790700.093092:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46530c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+11:8134:x1874634236503936:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787790700.093110:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790700.093129:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a45705c00/0x70647b5fa9774306 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496e9cd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790700.093178:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a45705c00/0x70647b5fa9774306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9cd expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790700.093187:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a45705c00/0x70647b5fa9774306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9cd expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790700.093196:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45705c00, rc 0) 00000100:00100000:1.0:1787790700.093275:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46530c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+12:8134:x1874634236503936:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 184us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790700.093283:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 211 00000100:00100000:2.0:1787790700.095378:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790700.095532:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236504064 00000100:00100000:0.0:1787790700.095543:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236504064 00000100:00100000:0.0:1787790700.095637:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 212 00000100:00100000:0.0:1787790700.095648:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46531850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+12:8134:x1874634236504064:12345-192.168.201.25@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787790700.095676:0:5841:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787790700.095703:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787790700.095708:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787790700.095711:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787790700.095714:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787790700.097185:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46531850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+12:8134:x1874634236504064:12345-192.168.201.25@tcp:256:mount.lustre.0 Request processed in 1531us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790700.097198:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 212 00000100:00100000:2.0:1787790700.100240:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790700.100428:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236504192 00000100:00100000:1.0:1787790700.100438:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236504192 00000100:00100000:1.0:1787790700.100533:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 213 00000100:00100000:1.0:1787790700.100542:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46530850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+12:8134:x1874634236504192:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787790700.100561:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790700.100580:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a45704e00/0x70647b5fa977430d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496e9d4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790700.100611:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a45704e00/0x70647b5fa977430d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9d4 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790700.100620:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a45704e00/0x70647b5fa977430d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9d4 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790700.100629:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45704e00, rc 0) 00000100:00100000:1.0:1787790700.100686:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46530850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+13:8134:x1874634236504192:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 146us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790700.100711:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 213 00000100:00100000:2.0:1787790700.105596:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790700.105971:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236504320 00000100:00100000:1.0:1787790700.105983:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236504320 00000100:00100000:1.0:1787790700.106077:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 214 00000100:00100000:1.0:1787790700.106089:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45663450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:8134:x1874634236504320:12345-192.168.201.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787790700.106463:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45663450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:8134:x1874634236504320:12345-192.168.201.25@tcp:501:mount.lustre.0 Request processed in 375us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790700.106472:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 214 00000100:00100000:2.0:1787790700.108845:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790700.108983:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236504448 00000100:00100000:3.0:1787790700.108993:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236504448 00000100:00100000:3.0:1787790700.109042:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 215 00000100:00100000:3.0:1787790700.109049:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+13:8134:x1874634236504448:12345-192.168.201.25@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787790700.109329:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+13:8134:x1874634236504448:12345-192.168.201.25@tcp:503:mount.lustre.0 Request processed in 278us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790700.109337:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 215 00000100:00100000:2.0:1787790700.115414:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790700.115523:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236504576 00000100:00100000:3.0:1787790700.115536:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236504576 00000100:00100000:3.0:1787790700.115610:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 216 00000100:00100000:3.0:1787790700.115640:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45661450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+13:8141:x1874634236504576:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787790700.116014:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45661450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+13:8141:x1874634236504576:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 375us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790700.116024:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 216 00000100:00100000:2.0:1787790700.119919:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790700.120028:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236504704 00000100:00100000:1.0:1787790700.120041:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236504704 00000100:00100000:1.0:1787790700.120107:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 217 00000100:00100000:1.0:1787790700.120119:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45660c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:8141:x1874634236504704:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787790700.120676:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45660c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:8141:x1874634236504704:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 557us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790700.120687:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 217 00000100:00100000:2.0:1787790700.129789:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790700.129897:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790700.130022:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236504832 00000100:00100000:0.0:1787790700.130031:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236505216 00000100:00100000:3.0:1787790700.130036:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236504832 00000100:00100000:0.0:1787790700.130038:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236505216 00000100:00100000:3.0:1787790700.130108:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:3.0:1787790700.130119:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9319469343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2345:x1874634236504832:12345-192.168.201.25@tcp:38:mount.lustre.0 00000100:00100000:0.0:1787790700.130176:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:0.0:1787790700.130187:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931946937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2349:x1874634236505216:12345-192.168.201.25@tcp:400:kworker.0 00010000:00080000:3.0:1787790700.130214:0:5847:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 96fed25c-dd19-4a75-a88a-8563aeaeed43@192.168.201.25@tcp t0 exp 0000000000000000 cur 235 last 0 00000100:00100000:0.0:1787790700.130292:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931946937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2349:x1874634236505216:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 108us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790700.130301:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 63 00000020:00000080:3.0:1787790700.130331:0:5847:0:(genops.c:1385:class_connect()) connect: client 96fed25c-dd19-4a75-a88a-8563aeaeed43, cookie 0x70647b5fa9774314 00000004:00100000:3.0:1787790700.130373:0:5847:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787790700.130410:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787790700.130905:0:5847:0:(import.c:65:import_set_state_nolock()) ffff931a464ea000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790700.130962:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9319469343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fed25c-dd19-4a75-a88a-8563aeaeed43+6:2345:x1874634236504832:12345-192.168.201.25@tcp:38:mount.lustre.0 Request processed in 841us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790700.130971:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:2.0:1787790700.139529:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790700.139661:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790700.139782:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236504960 00000100:00100000:0.0:1787790700.139796:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236504960 00000100:00100000:0.0:1787790700.139898:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236505088 00000100:00100000:0.0:1787790700.139902:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236505088 00000100:00100000:0.0:1787790700.139937:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00080000:1.0:1787790700.139941:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790700.139951:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9319469352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+7:0:x1874634236504960:12345-192.168.201.25@tcp:41:mount.lustre.0 00000100:00100000:1.0:1787790700.139982:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:1.0:1787790700.139995:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931946934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fed25c-dd19-4a75-a88a-8563aeaeed43+7:8134:x1874634236505088:12345-192.168.201.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787790700.140015:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000004:00000024:1.0:1787790700.140018:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787790700.140153:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931946934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fed25c-dd19-4a75-a88a-8563aeaeed43+7:8134:x1874634236505088:12345-192.168.201.25@tcp:41:mount.lustre.0 Request processed in 161us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790700.140163:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:0.0:1787790700.143271:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9319469352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+6:0:x1874634236504960:12345-192.168.201.25@tcp:41:mount.lustre.0 Request processed in 3298us (3729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790700.143309:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:2.0:1787790700.143975:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790700.144336:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236505344 00000100:00100000:1.0:1787790700.144358:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236505344 00000100:00100000:1.0:1787790700.144430:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:1.0:1787790700.144442:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931946936940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+6:8134:x1874634236505344:12345-192.168.201.25@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787790700.144991:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931946936940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+6:8134:x1874634236505344:12345-192.168.201.25@tcp:40:mount.lustre.0 Request processed in 549us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790700.146975:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:2.0:1787790700.150008:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790700.150411:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790700.151625:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790700.151764:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236505728 00000100:00100000:3.0:1787790700.151778:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236505728 00000100:00100000:3.0:1787790700.151854:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:3.0:1787790700.151866:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931946935e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+6:8134:x1874634236505728:12345-192.168.201.25@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787790700.152182:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787790700.152360:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931946935e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+6:8134:x1874634236505728:12345-192.168.201.25@tcp:33:mount.lustre.0 Request processed in 496us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790700.152370:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:0.0:1787790700.152867:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236505472 00000100:00100000:0.0:1787790700.152874:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236505472 00000100:00100000:0.0:1787790700.152912:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236505600 00000100:00100000:0.0:1787790700.152915:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236505600 00000100:00100000:0.0:1787790700.152938:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:0.0:1787790700.152947:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931946937840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1874634236505472:12345-192.168.201.25@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787790700.152979:0:6684:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 96fed25c-dd19-4a75-a88a-8563aeaeed43@192.168.201.25@tcp t0 exp 0000000000000000 cur 235 last 0 00000100:00100000:1.0:1787790700.152989:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:1.0:1787790700.152998:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931946936580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2345:x1874634236505600:12345-192.168.201.25@tcp:8:mount.lustre.0 00000020:00000080:0.0:1787790700.153016:0:6684:0:(genops.c:1385:class_connect()) connect: client 96fed25c-dd19-4a75-a88a-8563aeaeed43, cookie 0x70647b5fa977431b 00010000:00080000:1.0:1787790700.153022:0:8297:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 96fed25c-dd19-4a75-a88a-8563aeaeed43@192.168.201.25@tcp t0 exp 0000000000000000 cur 235 last 0 00002000:00100000:0.0:1787790700.153034:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 96fed25c-dd19-4a75-a88a-8563aeaeed43/ffff931a42e72000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000020:00000080:1.0:1787790700.153047:0:8297:0:(genops.c:1385:class_connect()) connect: client 96fed25c-dd19-4a75-a88a-8563aeaeed43, cookie 0x70647b5fa9774322 00002000:00100000:1.0:1787790700.153056:0:8297:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 96fed25c-dd19-4a75-a88a-8563aeaeed43/ffff931a7d971000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787790700.153066:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:1.0:1787790700.153075:0:8297:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787790700.153452:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:1.0:1787790700.153459:0:8297:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787790700.153491:0:8297:0:(import.c:65:import_set_state_nolock()) ffff931a7d974000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1787790700.153491:0:6684:0:(import.c:65:import_set_state_nolock()) ffff931a42e72800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787790700.153548:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931946936580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+6:2345:x1874634236505600:12345-192.168.201.25@tcp:8:mount.lustre.0 Request processed in 550us (3138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790700.153556:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:0.0:1787790700.155635:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931946937840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96fed25c-dd19-4a75-a88a-8563aeaeed43+6:2345:x1874634236505472:12345-192.168.201.25@tcp:8:mount.lustre.0 Request processed in 2673us (5626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790700.155652:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00010000:00010000:0.0:1787790700.288310:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787790700.708957:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 96fed25c-dd19-4a75-a88a-8563aeaeed43 00010000:00010000:0.0:1787790701.312656:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787790701.712218:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 96fed25c-dd19-4a75-a88a-8563aeaeed43 00000001:00100000:3.0:1787790702.223695:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 96fed25c-dd19-4a75-a88a-8563aeaeed43 00010000:00010000:0.0:1787790702.336835:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790702.656137:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787790702.656170:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c2692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253314560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787790702.656474:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790702.656707:0:8510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253314560 00000100:00100000:0.0:1787790702.656719:0:8510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253314560 00000100:00100000:0.0:1787790702.656904:0:8510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787790702.656918:0:8510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253314560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787790702.656968:0:8510:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787790702.657045:0:8510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253314560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790702.657068:0:8510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787790702.657416:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787790702.657674:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7c2692c0 x1874634253314560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790702.657714:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c2692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253314560:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787790703.360255:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790703.680386:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253314688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790703.680543:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790703.682365:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253314688 00000100:00100000:3.0:1787790703.682405:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253314688 00000100:00100000:3.0:1787790703.682503:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787790703.682515:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d793c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253314688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787790703.682579:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790703.682682:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d793c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253314688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (2140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790703.682690:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1787790703.682773:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7c268f00 x1874634253314688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790703.682798:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253314688:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787790703.682951:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790703.687286:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d790f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874634253314944:0@lo:400:kworker.0 00000100:00100000:1.0:1787790703.687382:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790703.687441:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787790703.687447:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d790b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253314816:0@lo:400:kworker.0 00000100:00100000:1.0:1787790703.687479:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790703.687506:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d792940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253315328:0@lo:400:kworker.0 00000100:00100000:1.0:1787790703.687550:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790703.687700:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253314944 00000100:00100000:2.0:1787790703.687709:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253314944 00000100:00100000:2.0:1787790703.687805:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253315328 00000100:00100000:2.0:1787790703.687808:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253315328 00000100:00100000:2.0:1787790703.687841:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787790703.687851:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874634253314944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790703.687914:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874634253314944:12345-0@lo:400:kworker.0 Request processed in 64us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790703.687922:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787790703.687939:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787790703.687946:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253315328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790703.687978:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253315328:12345-0@lo:400:kworker.0 Request processed in 33us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790703.687984:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1787790703.688147:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790703.688184:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d792940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253315328:0@lo:400:kworker.0 00000100:00100000:1.0:1787790703.688208:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d790f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874634253314944:0@lo:400:kworker.0 00000100:00100000:3.0:1787790703.688479:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d7912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253315072:0@lo:400:kworker.0 00000100:00100000:3.0:1787790703.688518:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790703.688551:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790703.688568:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253315200:0@lo:400:kworker.0 00000100:00100000:3.0:1787790703.688596:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790703.688768:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253315200 00000100:00100000:1.0:1787790703.688773:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253315200 00000100:00100000:1.0:1787790703.688808:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787790703.688815:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ee9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253315200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790703.688859:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ee9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253315200:12345-0@lo:400:kworker.0 Request processed in 45us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790703.688865:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787790703.688892:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7d793480 x1874634253315200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790703.688903:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253315200:0@lo:400:kworker.0 00000100:00100000:2.0:1787790703.689088:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253315072 00000100:00100000:2.0:1787790703.689093:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253315072 00000100:00100000:2.0:1787790703.689134:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787790703.689141:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53f05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253315072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790703.689198:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53f05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253315072:12345-0@lo:400:kworker.0 Request processed in 49us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790703.689206:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1787790703.689267:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790703.689289:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d7912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253315072:0@lo:400:kworker.0 00000100:00100000:0.0:1787790703.689582:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253314816 00000100:00100000:0.0:1787790703.689595:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253314816 00000100:00100000:0.0:1787790703.689662:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787790703.689672:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45661850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253314816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790703.689811:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45661850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253314816:12345-0@lo:400:kworker.0 Request processed in 140us (2329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790703.689819:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787790703.690053:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d790b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253314816:0@lo:400:kworker.0 00010000:00010000:0.0:1787790704.384502:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787790705.022688:0:10305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1787790705.408272:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790705.581933:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790705.581989:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790705.582030:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790705.582051:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790705.582103:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790705.582140:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236506240 00000100:00100000:3.0:1787790705.582151:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236506240 00000100:00100000:3.0:1787790705.582232:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236506368 00000100:00100000:3.0:1787790705.582236:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236506368 00000100:00100000:3.0:1787790705.582263:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:3.0:1787790705.582275:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81014780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2347:x1874634236506240:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790705.582386:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81014780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2347:x1874634236506240:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 112us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790705.582396:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:3.0:1787790705.582421:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:3.0:1787790705.582428:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2347:x1874634236506368:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790705.582457:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2347:x1874634236506368:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 30us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790705.582463:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:3.0:1787790705.582486:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236505984 00000100:00100000:3.0:1787790705.582490:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236505984 00000100:00100000:3.0:1787790705.582525:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236506112 00000100:00100000:3.0:1787790705.582528:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236506112 00000100:00100000:3.0:1787790705.582550:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:3.0:1787790705.582557:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2347:x1874634236505984:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790705.582589:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2347:x1874634236505984:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 33us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790705.582596:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:3.0:1787790705.582609:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:3.0:1787790705.582616:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2347:x1874634236506112:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790705.582641:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2347:x1874634236506112:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 26us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790705.582648:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:1.0:1787790705.584463:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236505856 00000100:00100000:1.0:1787790705.584478:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236505856 00000100:00100000:1.0:1787790705.584548:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 219 00000100:00100000:1.0:1787790705.584558:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45660850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:2347:x1874634236505856:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790705.584634:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45660850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:2347:x1874634236505856:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 77us (2602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790705.584661:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 219 00000100:00080000:1.0:1787790705.584706:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787790705.584713:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787790705.584716:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787790706.432182:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790707.458763:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790707.779614:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790707.779645:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253315456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790707.779757:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790707.779807:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253315456 00000100:00100000:3.0:1787790707.779817:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253315456 00000100:00100000:3.0:1787790707.779943:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787790707.779978:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253315456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790707.780035:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790707.780103:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253315456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790707.780132:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787790707.780189:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7beb0b40 x1874634253315456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790707.780211:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253315456:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787790707.781521:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787790708.489393:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790708.802062:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787790708.802099:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253315584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790708.802880:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790708.803124:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c2692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253315840:0@lo:400:kworker.0 00000100:00100000:3.0:1787790708.804780:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253315712:0@lo:400:kworker.0 00000100:00100000:3.0:1787790708.804979:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790708.805019:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5f902940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1874634253316224:0@lo:400:kworker.0 00000100:00100000:3.0:1787790708.805074:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253315712 00000100:00100000:3.0:1787790708.805084:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253315712 00000100:00100000:3.0:1787790708.805226:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787790708.805239:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45661c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3321:x1874634253315712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790708.805308:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45661c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3321:x1874634253315712:12345-0@lo:400:kworker.0 Request processed in 71us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790708.805316:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787790708.805420:0:8510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253315584 00000100:00100000:1.0:1787790708.805426:0:8510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253315584 00000100:00100000:1.0:1787790708.805522:0:8510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787790708.805531:0:8510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253315584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787790708.805572:0:8510:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787790708.805781:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790708.805984:0:8510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253315584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 453us (3106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790708.805992:0:8510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787790708.806053:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c26b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1874634253315968:0@lo:400:kworker.0 00000100:00100000:1.0:1787790708.806091:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5f903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253316096:0@lo:400:kworker.0 00000100:00100000:1.0:1787790708.806135:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790708.806181:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790708.806462:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253316096 00000100:00100000:3.0:1787790708.806467:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253316096 00000100:00100000:3.0:1787790708.806548:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787790708.806564:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253316096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.807133:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5f9030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253316352:0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.807166:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790708.807285:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253316352 00000100:00100000:0.0:1787790708.807291:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253316352 00000100:00100000:0.0:1787790708.807329:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787790708.807337:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5f901a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253316352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790708.807361:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253316096:12345-0@lo:400:kworker.0 Request processed in 795us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790708.807370:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787790708.807401:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253315840 00000100:00100000:3.0:1787790708.807405:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253315840 00000100:00100000:3.0:1787790708.807434:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787790708.807441:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5f9003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253315840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790708.807483:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5f9003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253315840:12345-0@lo:400:kworker.0 Request processed in 43us (4315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790708.807490:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1787790708.807534:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a5f903480 x1874634253316096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790708.807551:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5f903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253316096:0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.807961:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5f901a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253316352:12345-0@lo:400:kworker.0 Request processed in 624us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790708.807970:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787790708.808007:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790708.808010:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c2692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253315840:0@lo:400:kworker.0 00010000:00080000:0.0:1787790708.808025:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a5f9030c0 x1874634253316352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790708.808048:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5f9030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253316352:0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.808089:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790708.808141:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253315968 00000100:00100000:3.0:1787790708.808147:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253315968 00010000:00080000:0.0:1787790708.808164:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7c268000 x1874634253315584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790708.808184:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253315584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790708.808251:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253316224 00000100:00100000:1.0:1787790708.808256:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253316224 00000100:00100000:3.0:1787790708.808305:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787790708.808309:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253315712:0@lo:400:kworker.0 00000100:00100000:3.0:1787790708.808316:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874634253315968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790708.808368:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874634253315968:12345-0@lo:400:kworker.0 Request processed in 55us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790708.808376:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787790708.808476:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787790708.808485:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5f9030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874634253316224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790708.808526:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5f9030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874634253316224:12345-0@lo:400:kworker.0 Request processed in 43us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790708.808540:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787790708.808603:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5f902940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1874634253316224:0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.808690:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c26b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1874634253315968:0@lo:400:kworker.0 00000100:00080000:2.0:1787790708.808765:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787790709.503882:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790710.534275:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790710.703450:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790710.703532:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790710.703572:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790710.703610:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790710.703658:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236506496 00000100:00100000:0.0:1787790710.703671:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236506496 00000100:00100000:0.0:1787790710.703765:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 221 00000100:00100000:0.0:1787790710.703778:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45660050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+13:2348:x1874634236506496:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790710.703877:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45660050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+13:2348:x1874634236506496:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 102us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790710.703886:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 221 00000100:00100000:1.0:1787790710.703991:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236506880 00000100:00100000:1.0:1787790710.703996:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236506880 00000100:00100000:1.0:1787790710.704056:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:1.0:1787790710.704065:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d7921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2348:x1874634236506880:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790710.704107:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d7921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2348:x1874634236506880:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 45us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790710.704115:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00080000:0.0:1787790710.704174:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790710.704568:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790710.704624:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236507008 00000100:00100000:2.0:1787790710.704629:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236507008 00000100:00100000:2.0:1787790710.704669:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:2.0:1787790710.704678:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d790780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2348:x1874634236507008:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790710.704773:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d790780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2348:x1874634236507008:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 96us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790710.704780:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00080000:2.0:1787790710.704908:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787790710.705181:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236506624 00000100:00100000:3.0:1787790710.705187:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236506624 00000100:00100000:3.0:1787790710.705236:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236506752 00000100:00100000:3.0:1787790710.705240:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236506752 00000100:00100000:3.0:1787790710.705267:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 72 00000100:00100000:3.0:1787790710.705274:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d792d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2348:x1874634236506624:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790710.705340:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d792d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2348:x1874634236506624:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 66us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790710.705347:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 72 00000100:00100000:3.0:1787790710.705366:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 73 00000100:00100000:3.0:1787790710.705373:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d792580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2348:x1874634236506752:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790710.705398:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d792580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2348:x1874634236506752:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 25us (1787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790710.705404:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 73 00000100:00080000:2.0:1787790710.705584:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787790711.554298:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790712.576146:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790712.898279:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a465b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253316480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787790712.898382:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790712.898907:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253316480 00000100:00100000:3.0:1787790712.898919:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253316480 00000100:00100000:3.0:1787790712.899014:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1787790712.899156:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790712.899484:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5f901680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253316480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790712.899535:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790712.899625:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5f901680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253316480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 601us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790712.899633:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787790712.899696:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a465b61c0 x1874634253316480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790712.899717:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a465b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253316480:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787790713.601170:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790713.921154:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787790713.921180:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5f902d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253316608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790713.921255:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790713.921405:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253316864:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.921448:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790713.921470:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790713.921476:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253316992:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.921510:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790713.921552:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253316864 00000100:00100000:1.0:1787790713.921559:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253316864 00000100:00100000:1.0:1787790713.921612:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253316992 00000100:00100000:1.0:1787790713.921616:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253316992 00000100:00100000:1.0:1787790713.921644:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787790713.921651:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a47929a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253316864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.921707:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a47929a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253316864:12345-0@lo:400:kworker.0 Request processed in 56us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790713.921715:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787790713.921758:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787790713.921768:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a47929e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253316992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.921796:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a47929e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253316992:12345-0@lo:400:kworker.0 Request processed in 31us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790713.921801:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787790713.921825:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790713.921857:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253316992:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.921868:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253316864:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.921896:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253316736:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.921925:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790713.921949:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a479283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1874634253317248:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.921969:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790713.921985:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787790713.921990:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4792b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253317120:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.922024:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790713.922051:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253316736 00000100:00100000:1.0:1787790713.922055:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253316736 00000100:00100000:1.0:1787790713.922082:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787790713.922089:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3321:x1874634253316736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.922121:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3321:x1874634253316736:12345-0@lo:400:kworker.0 Request processed in 33us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790713.922137:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787790713.922165:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253317120 00000100:00100000:1.0:1787790713.922169:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253317120 00000100:00100000:1.0:1787790713.922198:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787790713.922203:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4792b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253317120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.922234:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4792b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253317120:12345-0@lo:400:kworker.0 Request processed in 31us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790713.922240:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787790713.922263:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253317248 00000100:00100000:1.0:1787790713.922266:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253317248 00000100:00100000:1.0:1787790713.922292:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787790713.922298:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a47929680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874634253317248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.922325:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a47929680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874634253317248:12345-0@lo:400:kworker.0 Request processed in 28us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790713.922331:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1787790713.922345:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787790713.922363:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a4792b0c0 x1874634253317120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790713.922375:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4792b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253317120:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.922383:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253316736:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.922391:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a479283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1874634253317248:0@lo:400:kworker.0 00000100:00100000:0.0:1787790713.922806:0:8510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253316608 00000100:00100000:0.0:1787790713.922811:0:8510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253316608 00000100:00100000:0.0:1787790713.922863:0:8510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787790713.922871:0:8510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253316608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787790713.922914:0:8510:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787790713.922957:0:8510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253316608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790713.922964:0:8510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787790713.923335:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787790713.923365:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a5f902d00 x1874634253316608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790713.923383:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5f902d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253316608:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787790714.624045:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790715.649295:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790715.820602:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790715.820656:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790715.820758:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236507264 00000100:00100000:1.0:1787790715.820771:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236507264 00000100:00100000:1.0:1787790715.820849:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 77 00000100:00100000:1.0:1787790715.820862:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d791680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2349:x1874634236507264:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790715.820952:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d791680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2349:x1874634236507264:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 94us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790715.820959:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 77 00000100:00100000:3.0:1787790715.821113:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236507136 00000100:00100000:3.0:1787790715.821118:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236507136 00000100:00100000:3.0:1787790715.821153:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 223 00000100:00100000:3.0:1787790715.821169:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+13:2348:x1874634236507136:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790715.821200:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+13:2348:x1874634236507136:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 34us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790715.821222:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 223 00000100:00080000:2.0:1787790715.821561:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790715.827797:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790715.827842:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790715.827879:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790715.827914:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236507648 00000100:00100000:3.0:1787790715.827926:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236507648 00000100:00100000:3.0:1787790715.828007:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236507520 00000100:00100000:3.0:1787790715.828010:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236507520 00000100:00100000:3.0:1787790715.828039:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:3.0:1787790715.828051:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2348:x1874634236507648:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790715.828143:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2348:x1874634236507648:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 94us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790715.828151:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:3.0:1787790715.828172:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:3.0:1787790715.828177:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2349:x1874634236507520:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790715.828201:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2349:x1874634236507520:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 24us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790715.828207:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00080000:3.0:1787790715.828222:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787790715.828226:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790715.828405:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236507392 00000100:00100000:1.0:1787790715.828410:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236507392 00000100:00100000:1.0:1787790715.828454:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00100000:1.0:1787790715.828461:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2348:x1874634236507392:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790715.828494:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2348:x1874634236507392:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 34us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790715.828500:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00080000:3.0:1787790715.828769:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787790716.679937:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790717.698991:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790718.015998:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787790718.016022:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a465b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253317376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787790718.017795:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790718.019007:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253317376 00000100:00100000:3.0:1787790718.019018:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253317376 00000100:00100000:3.0:1787790718.019096:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787790718.019106:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d791e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253317376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790718.019143:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790718.019223:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d791e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253317376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790718.019231:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787790718.019327:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a465b4b40 x1874634253317376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790718.019348:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a465b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253317376:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787790718.019460:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787790718.721122:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790719.040694:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790719.040719:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4792b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253317504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790719.040809:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790719.041198:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5f900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253317888:0@lo:400:kworker.0 00000100:00100000:0.0:1787790719.041232:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790719.041250:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787790719.041256:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5f903c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253318016:0@lo:400:kworker.0 00000100:00100000:0.0:1787790719.041280:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790719.041308:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253318016 00000100:00100000:0.0:1787790719.041329:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253318016 00000100:00100000:0.0:1787790719.041379:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787790719.041389:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5f9012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253318016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790719.041437:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5f9012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253318016:12345-0@lo:400:kworker.0 Request processed in 50us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790719.041444:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787790719.041697:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5f902580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253317632:0@lo:400:kworker.0 00000100:00100000:2.0:1787790719.041754:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790719.041781:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5f900b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1874634253318144:0@lo:400:kworker.0 00000100:00100000:2.0:1787790719.041804:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790719.041824:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787790719.041843:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5f900780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253317760:0@lo:400:kworker.0 00000100:00100000:2.0:1787790719.041867:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790719.041894:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253317632 00000100:00100000:2.0:1787790719.041899:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253317632 00000100:00100000:2.0:1787790719.041937:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787790719.041944:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45663050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3320:x1874634253317632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790719.041976:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45663050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3320:x1874634253317632:12345-0@lo:400:kworker.0 Request processed in 33us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790719.041983:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787790719.042010:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253317888 00000100:00100000:2.0:1787790719.042014:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253317888 00000100:00100000:2.0:1787790719.042043:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253318144 00000100:00100000:2.0:1787790719.042046:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253318144 00000100:00100000:2.0:1787790719.042059:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253317760 00000100:00100000:2.0:1787790719.042061:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253317760 00000100:00100000:2.0:1787790719.042071:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787790719.042077:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5f900f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253317888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790719.042105:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5f900f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253317888:12345-0@lo:400:kworker.0 Request processed in 28us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790719.042123:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787790719.042134:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787790719.042140:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d7903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874634253318144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790719.042164:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d7903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874634253318144:12345-0@lo:400:kworker.0 Request processed in 25us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790719.042170:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787790719.042180:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787790719.042185:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d790b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253317760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790719.042217:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d790b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253317760:12345-0@lo:400:kworker.0 Request processed in 32us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790719.042223:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1787790719.042244:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790719.042273:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5f900780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253317760:0@lo:400:kworker.0 00000100:00100000:2.0:1787790719.042282:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5f902580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253317632:0@lo:400:kworker.0 00000100:00100000:2.0:1787790719.042291:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5f900b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1874634253318144:0@lo:400:kworker.0 00010000:00080000:0.0:1787790719.042587:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a5f903c00 x1874634253318016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790719.042603:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5f903c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253318016:0@lo:400:kworker.0 00000100:00100000:0.0:1787790719.042618:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5f900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253317888:0@lo:400:kworker.0 00000100:00100000:1.0:1787790719.044699:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253317504 00000100:00100000:1.0:1787790719.044714:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253317504 00000100:00100000:1.0:1787790719.044837:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787790719.044847:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253317504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787790719.044887:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787790719.044971:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253317504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (4161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790719.044994:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1787790719.045210:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787790719.045294:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a4792b0c0 x1874634253317504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790719.045333:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4792b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253317504:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787790719.746941:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787790720.099443:0:11005:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787790720.768343:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790720.942061:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790720.942170:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236507776 00000100:00100000:1.0:1787790720.942193:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236507776 00000100:00100000:1.0:1787790720.942272:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 225 00000100:00100000:1.0:1787790720.942286:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45663850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:2347:x1874634236507776:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790720.942399:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45663850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:2347:x1874634236507776:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 117us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790720.942408:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 225 00000100:00100000:3.0:1787790720.943276:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790720.943311:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790720.943349:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236507904 00000100:00100000:2.0:1787790720.943358:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236507904 00000100:00100000:1.0:1787790720.943376:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236508032 00000100:00100000:1.0:1787790720.943382:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236508032 00000100:00080000:0.0:1787790720.943441:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790720.943461:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 82 00000100:00100000:1.0:1787790720.943471:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2346:x1874634236508032:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790720.943584:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 83 00000100:00100000:2.0:1787790720.943593:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2346:x1874634236507904:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790720.944331:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2346:x1874634236508032:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 856us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790720.944342:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 82 00000100:00100000:2.0:1787790720.944646:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2346:x1874634236507904:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 1053us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790720.944655:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790720.944661:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 83 00000100:00080000:2.0:1787790720.944687:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790720.944715:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790720.944759:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236508160 00000100:00100000:2.0:1787790720.944767:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236508160 00000100:00100000:2.0:1787790720.944877:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236508288 00000100:00100000:2.0:1787790720.944881:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236508288 00000100:00080000:3.0:1787790720.944925:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787790720.944937:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790720.945402:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:1.0:1787790720.945414:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2345:x1874634236508160:12345-192.168.201.25@tcp:9:kworker.0 00000020:00000080:1.0:1787790720.945447:0:8297:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa977431b 00000100:00080000:1.0:1787790720.945460:0:8297:0:(import.c:65:import_set_state_nolock()) ffff931a42e72800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787790720.945520:0:8297:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787790720.945591:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:2.0:1787790720.945601:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a80f52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2345:x1874634236508288:12345-192.168.201.25@tcp:9:kworker.0 00000020:00000080:2.0:1787790720.945617:0:6685:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa9774322 00000100:00080000:2.0:1787790720.945626:0:6685:0:(import.c:65:import_set_state_nolock()) ffff931a7d974000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787790720.945659:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787790720.946142:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+2:2345:x1874634236508160:12345-192.168.201.25@tcp:9:kworker.0 Request processed in 729us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790720.946151:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:2.0:1787790720.946244:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a80f52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96fed25c-dd19-4a75-a88a-8563aeaeed43+2:2345:x1874634236508288:12345-192.168.201.25@tcp:9:kworker.0 Request processed in 643us (1527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790720.946254:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00010000:00010000:0.0:1787790720.946534:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790720.946782:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787790721.169647:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 96fed25c-dd19-4a75-a88a-8563aeaeed43 00000020:00000080:2.0:1787790721.169659:0:7630:0:(genops.c:885:class_export_put()) final put ffff931a7d971000/96fed25c-dd19-4a75-a88a-8563aeaeed43 00000020:00000080:0.0:1787790721.169748:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff931a7d971000/96fed25c-dd19-4a75-a88a-8563aeaeed43 for lustre-OST0001 00000020:00000080:0.0:1787790721.169811:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff931a7d974000 for lustre-OST0001 00010000:00010000:0.0:1787790721.799113:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787790722.657112:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 96fed25c-dd19-4a75-a88a-8563aeaeed43 00000020:00000080:3.0:1787790722.657122:0:6709:0:(genops.c:885:class_export_put()) final put ffff931a42e72000/96fed25c-dd19-4a75-a88a-8563aeaeed43 00000020:00000080:3.0:1787790722.657148:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff931a42e72000/96fed25c-dd19-4a75-a88a-8563aeaeed43 for lustre-OST0000 00000020:00000080:3.0:1787790722.657205:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff931a42e72800 for lustre-OST0000 00010000:00010000:2.0:1787790722.815953:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790723.143652:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a465b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253318272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790723.143833:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790723.144026:0:8510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253318272 00000100:00100000:3.0:1787790723.144037:0:8510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253318272 00000100:00100000:3.0:1787790723.144117:0:8510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787790723.144129:0:8510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4792a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253318272:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787790723.144212:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787790723.144275:0:8510:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790723.144335:0:8510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4792a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253318272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 209us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790723.144342:0:8510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787790723.144446:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a465b4780 x1874634253318272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790723.144516:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a465b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253318272:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1787790723.350676:0:11156:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0cbfac10 20000000:00000080:1.0:1787790723.350703:0:11156:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff931a46580c00 uarg=0000000000000000 20000000:01000000:1.0:1787790723.351009:0:11156:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787790723.351020:0:11156:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787790723.351027:0:11156:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787790723.352226:0:11157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787790723.352406:0:11156:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787790723.360184:0:11156:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787790723.360213:0:11156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff931a45704400/0x70647b5fa9774329 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.360229:0:11156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a52849c00/0x70647b5fa97742d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97742ce expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.360235:0:11156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a542f1800/0x70647b5fa97742e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97742dc expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.360239:0:11156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a542f1200/0x70647b5fa97742f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97742ea expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.360245:0:11156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a542f0200/0x70647b5fa97742f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e99c expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.360249:0:11156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a45704e00/0x70647b5fa977430d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9d4 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.360270:0:11156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff931a45704400/0x70647b5fa9774329 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.360306:0:11156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a45704e00/0x70647b5fa977430d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9d4 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.360931:0:11156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff931a45704e00/0x70647b5fa977430d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9d4 expref: 12 pid: 5840 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790723.360947:0:11156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4792a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1874634253318400:192.168.201.25@tcp:104: 00010000:00010000:1.0:1787790723.361144:0:11156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a542f0200/0x70647b5fa97742f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e99c expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.361151:0:11156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff931a542f0200/0x70647b5fa97742f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e99c expref: 12 pid: 5840 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790723.361190:0:11156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a47928780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1874634253318528:192.168.201.25@tcp:104: 00010000:00010000:1.0:1787790723.361221:0:11156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a542f1200/0x70647b5fa97742f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa97742ea expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.361227:0:11156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a542f1200/0x70647b5fa97742f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa97742ea expref: 18 pid: 5838 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790723.361234:0:11156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a47928000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1874634253318656:0@lo:104: 00000100:00100000:1.0:1787790723.361265:0:11156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790723.361302:0:11156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a542f1800/0x70647b5fa97742e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa97742dc expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790723.361313:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253318656 00000100:00100000:0.0:1787790723.361326:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253318656 00000100:00100000:0.0:1787790723.361411:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787790723.361422:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4792bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:11156:x1874634253318656:12345-0@lo:104: 00010000:00010000:0.0:1787790723.361441:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97742ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97742f1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.361451:0:11156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a542f1800/0x70647b5fa97742e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa97742dc expref: 18 pid: 5841 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790723.361465:0:11156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a47928b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1874634253318784:0@lo:104: 00000100:00100000:1.0:1787790723.361487:0:11156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790723.361504:0:11156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a52849c00/0x70647b5fa97742d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa97742ce expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.361511:0:11156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a52849c00/0x70647b5fa97742d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa97742ce expref: 18 pid: 5841 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790723.361518:0:11156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a479292c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1874634253318912:0@lo:104: 00000100:00100000:1.0:1787790723.361544:0:11156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787790723.361572:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787790723.361580:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4792bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:11156:x1874634253318656:12345-0@lo:104: Request processed in 160us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790723.361588:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787790723.361611:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253318784 00000100:00100000:1.0:1787790723.361616:0:11156:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a488cb840 going to sleep for 11 seconds 00000100:00100000:0.0:1787790723.361616:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253318784 00000100:00100000:0.0:1787790723.361639:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253318912 00000100:00100000:1.0:1787790723.361643:0:11156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a47928000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1874634253318656:0@lo:104: 00000100:00100000:0.0:1787790723.361656:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253318912 00000100:00100000:0.0:1787790723.361676:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787790723.361683:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a47928f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+4:11156:x1874634253318784:12345-0@lo:104: 00010000:00010000:0.0:1787790723.361693:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a542f0c00/0x70647b5fa97742dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97742e3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.361825:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787790723.361832:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a47928f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+4:11156:x1874634253318784:12345-0@lo:104: Request processed in 148us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790723.361837:0:11156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a47928b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1874634253318784:0@lo:104: 00000100:00100000:0.0:1787790723.361846:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787790723.361882:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787790723.361889:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4792b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:11156:x1874634253318912:12345-0@lo:104: 00010000:00010000:0.0:1787790723.361897:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97742ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97742d5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.361939:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787790723.361944:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4792b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:11156:x1874634253318912:12345-0@lo:104: Request processed in 57us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790723.361950:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787790723.361970:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787790723.361977:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97742ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97742f1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.361984:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a52849e00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:0.0:1787790723.361989:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97742ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa97742f1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.361999:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97742ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa97742f1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790723.362007:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97742ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa97742f1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790723.362013:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787790723.362062:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97742ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97742f1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.362069:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790723.362098:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97742ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97742f1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790723.362107:0:11156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a479292c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1874634253318912:0@lo:104: 00010000:00010000:0.0:1787790723.362111:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a52849e00/0x70647b5fa97742ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97742f1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.362132:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787790723.362136:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a542f0c00/0x70647b5fa97742dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97742e3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.362141:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f0c00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:0.0:1787790723.362145:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a542f0c00/0x70647b5fa97742dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa97742e3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.362152:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a542f0c00/0x70647b5fa97742dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa97742e3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790723.362158:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a542f0c00/0x70647b5fa97742dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa97742e3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790723.362164:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787790723.362178:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a542f0c00/0x70647b5fa97742dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97742e3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.362184:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790723.362190:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a542f0c00/0x70647b5fa97742dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97742e3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.362208:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a542f0c00/0x70647b5fa97742dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97742e3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.362222:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790723.362225:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97742ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97742d5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.362230:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705000 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:0.0:1787790723.362233:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97742ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa97742d5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.362239:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97742ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa97742d5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790723.362245:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97742ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa97742d5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790723.362251:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787790723.362265:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97742ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97742d5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.362271:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790723.362296:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97742ce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97742d5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.362305:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97742ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97742d5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.362322:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790723.362331:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790723.362333:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790723.362342:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790723.362370:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5f900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253319040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787790723.362415:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790723.362456:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787790723.362462:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5f903c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253319168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790723.362466:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5f901a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253319296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787790723.362491:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790723.362523:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790723.362555:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253319040 00000100:00100000:0.0:1787790723.362561:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253319040 00010000:00010000:0.0:1787790723.362587:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a542f1200/0x70647b5fa97742f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97742ea expref: 19 pid: 5838 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790723.362611:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253319168 00000100:00100000:0.0:1787790723.362614:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253319168 00010000:00010000:0.0:1787790723.362625:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a542f1800/0x70647b5fa97742e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97742dc expref: 20 pid: 5841 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790723.362635:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253319296 00000100:00100000:0.0:1787790723.362637:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253319296 00010000:00010000:0.0:1787790723.362649:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a52849c00/0x70647b5fa97742d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97742ce expref: 21 pid: 5841 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790723.362661:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787790723.362668:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a493ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+21:3318:x1874634253319040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790723.362680:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790723.362686:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a542f1200/0x70647b5fa97742f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97742ea expref: 21 pid: 5838 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.362697:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a542f1200/0x70647b5fa97742f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa97742ea expref: 21 pid: 5838 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.362721:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a542f1200/0x70647b5fa97742f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa97742ea expref: 21 pid: 5838 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.362787:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790723.362823:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a493ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+20:3318:x1874634253319040:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790723.362830:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787790723.362892:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787790723.362899:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5f9012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3318:x1874634253319168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790723.362907:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790723.362911:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a542f1800/0x70647b5fa97742e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97742dc expref: 19 pid: 5841 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.362920:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a542f1800/0x70647b5fa97742e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa97742dc expref: 19 pid: 5841 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.362931:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a542f1800/0x70647b5fa97742e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa97742dc expref: 19 pid: 5841 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.362940:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790723.362962:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5f9012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:3318:x1874634253319168:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790723.362969:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787790723.362982:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787790723.362988:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4792a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:3320:x1874634253319296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790723.362995:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790723.362998:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a52849c00/0x70647b5fa97742d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97742ce expref: 17 pid: 5841 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.363015:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a52849c00/0x70647b5fa97742d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa97742ce expref: 17 pid: 5841 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.363026:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a52849c00/0x70647b5fa97742d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa97742ce expref: 17 pid: 5841 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.363035:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790723.363057:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4792a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:3320:x1874634253319296:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790723.363064:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787790723.363109:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5f903c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253319168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787790723.363121:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5f900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253319040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790723.363956:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5f901a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253319296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790723.366287:0:11156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a47928780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1874634253318528:192.168.201.25@tcp:104: 00000100:00100000:1.0:1787790723.366922:0:11156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4792a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1874634253318400:192.168.201.25@tcp:104: 00010000:00010000:1.0:1787790723.366980:0:11156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff931a45704400/0x70647b5fa9774329 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790723.367191:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790723.367229:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790723.367273:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236508416 00000100:00100000:1.0:1787790723.367292:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236508416 00000100:00100000:2.0:1787790723.367315:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236508544 00000100:00100000:2.0:1787790723.367323:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236508544 00010000:00010000:1.0:1787790723.367336:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a542f0200/0x70647b5fa97742f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e99c expref: 14 pid: 5840 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790723.367360:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a45704e00/0x70647b5fa977430d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9d4 expref: 14 pid: 5840 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790723.367538:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:1.0:1787790723.367547:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b956aedb-a574-46fa-b700-b912aca9a68a+14:2348:x1874634236508416:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790723.367616:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790723.367622:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a542f0200/0x70647b5fa97742f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e99c expref: 14 pid: 5840 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.367631:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a542f0200/0x70647b5fa97742f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e99c expref: 14 pid: 5840 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.367646:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a542f0200/0x70647b5fa97742f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e99c expref: 14 pid: 5840 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.367664:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790723.367720:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b956aedb-a574-46fa-b700-b912aca9a68a+13:2348:x1874634236508416:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 174us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790723.367756:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:1.0:1787790723.367772:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 29 00000100:00100000:1.0:1787790723.367777:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b956aedb-a574-46fa-b700-b912aca9a68a+12:2349:x1874634236508544:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790723.367783:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790723.367786:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a45704e00/0x70647b5fa977430d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9d4 expref: 12 pid: 5840 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.367792:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a45704e00/0x70647b5fa977430d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9d4 expref: 12 pid: 5840 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.367921:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a45704e00/0x70647b5fa977430d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9d4 expref: 12 pid: 5840 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.367929:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff931a45704400/0x70647b5fa9774329 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.367935:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a45704400/0x70647b5fa9774329 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.367947:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a45704400/0x70647b5fa9774329 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.367951:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a45704400/0x70647b5fa9774329 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.367955:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff931a45704400/0x70647b5fa9774329 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.367960:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff931a45704400/0x70647b5fa9774329 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.367963:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704400 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790723.368026:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff931a45704400/0x70647b5fa9774329 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.368097:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff931a45704400/0x70647b5fa9774329 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.368113:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff931a45704400/0x70647b5fa9774329 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.368134:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790723.368171:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b956aedb-a574-46fa-b700-b912aca9a68a+11:2349:x1874634236508544:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 379us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790723.368179:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 29 00010000:00010000:1.0:1787790723.368339:0:11156:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff931a45704400/0x70647b5fa9774329 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.368347:0:11156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff931a45704400/0x70647b5fa9774329 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790723.368353:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a45704400/0x70647b5fa9774329 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790723.847538:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790724.161424:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4792a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253319424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790724.161513:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790724.161648:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253319424 00000100:00100000:3.0:1787790724.161675:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253319424 00000100:00100000:3.0:1787790724.161798:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787790724.161825:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d792940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253319808:0@lo:400:kworker.0 00000100:00100000:3.0:1787790724.161830:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5f900000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253319424:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790724.161880:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790724.161907:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00002000:00000024:3.0:1787790724.161910:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787790724.161915:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d790780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253319936:0@lo:400:kworker.0 00000100:00100000:2.0:1787790724.161951:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790724.161978:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5f900000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253319424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 168us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790724.161987:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787790724.162218:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253319936 00000100:00100000:1.0:1787790724.162224:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253319936 00000100:00100000:1.0:1787790724.162267:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787790724.162275:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d791a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253319936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790724.162327:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d791a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253319936:12345-0@lo:400:kworker.0 Request processed in 55us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790724.162334:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787790724.162421:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7d790780 x1874634253319936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790724.162436:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d790780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253319936:0@lo:400:kworker.0 00000100:00100000:0.0:1787790724.162517:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d790f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874634253319680:0@lo:400:kworker.0 00000100:00100000:2.0:1787790724.162523:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253319552:0@lo:400:kworker.0 00000100:00100000:0.0:1787790724.162552:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790724.162600:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253319808 00000100:00100000:0.0:1787790724.162605:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253319808 00000100:00100000:2.0:1787790724.162629:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790724.162658:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d7921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1874634253320064:0@lo:400:kworker.0 00000100:00100000:2.0:1787790724.162685:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787790724.173955:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787790724.173971:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787790724.174038:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253319680 00000100:00100000:0.0:1787790724.174051:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253319680 00000100:00100000:0.0:1787790724.174095:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253320064 00000100:00100000:0.0:1787790724.174097:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253320064 00000100:00100000:0.0:1787790724.174127:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787790724.174146:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d7912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253319808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790724.174216:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787790724.174224:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5f903c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874634253319680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790724.174289:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5f903c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874634253319680:12345-0@lo:400:kworker.0 Request processed in 67us (11739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790724.174295:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787790724.174311:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787790724.174315:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d7930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874634253320064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790724.174380:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d7930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874634253320064:12345-0@lo:400:kworker.0 Request processed in 62us (11692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790724.174387:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1787790724.174426:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787790724.174478:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a4792a580 x1874634253319424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790724.174502:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4792a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253319424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790724.175138:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d790f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874634253319680:0@lo:400:kworker.0 00000100:00100000:1.0:1787790724.175172:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d7921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1874634253320064:0@lo:400:kworker.0 00000100:00100000:0.0:1787790724.175262:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d7912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253319808:12345-0@lo:400:kworker.0 Request processed in 1118us (13382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790724.175282:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253319552 00000100:00100000:1.0:1787790724.175288:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253319552 00000100:00100000:1.0:1787790724.175323:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787790724.175329:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45662850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:3318:x1874634253319552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790724.175373:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45662850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:3318:x1874634253319552:12345-0@lo:400:kworker.0 Request processed in 44us (12746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790724.175377:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787790724.175412:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253319552:0@lo:400:kworker.0 00000100:00100000:1.0:1787790724.175439:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d792940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253319808:0@lo:400:kworker.0 00000100:00100000:0.0:1787790724.175540:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 10000000:01000000:2.0:1787790724.610030:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787790724.610048:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9319447e6800 from 7 10000000:01000000:2.0:1787790724.610052:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787790724.610097:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa9774330 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790724.610110:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa9774330 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790724.610122:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa9774330 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790724.610151:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d793840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253320192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787790724.610218:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790724.610261:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a43a1c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790724.610283:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253320192 00000100:00100000:2.0:1787790724.610290:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253320192 00000100:00100000:2.0:1787790724.610336:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787790724.610345:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45662050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:5843:x1874634253320192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790724.610359:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790724.610371:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a542f1000/0x70647b5fa9774337 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9774330 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790724.610394:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a542f1000/0x70647b5fa9774337 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9774330 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790724.610405:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a542f1000/0x70647b5fa9774337 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9774330 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790724.610413:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f1000, rc 0) 00000100:00100000:2.0:1787790724.610452:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45662050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253320192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790724.610465:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787790724.610515:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d793840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253320192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790724.610530:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa9774330 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774337 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790724.610539:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa9774330 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9774337 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790724.610589:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d793840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253320320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790724.610614:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790724.610627:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a43a1c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790724.611334:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253320320 00000100:00100000:1.0:1787790724.611341:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253320320 00000100:00100000:1.0:1787790724.611371:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787790724.611379:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45661050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253320320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790724.611662:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45661050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253320320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790724.611680:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787790724.612185:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d793840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253320320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790724.612248:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d793840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253320448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790724.612296:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790724.612323:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a43a1c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790724.613367:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253320448 00000100:00100000:1.0:1787790724.613376:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253320448 00000100:00100000:1.0:1787790724.613437:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787790724.613447:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45662450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253320448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787790724.613669:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45662450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253320448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 223us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790724.613677:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787790724.613839:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d793840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253320448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787790724.617628:0:11178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787790724.618914:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787790724.618944:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787790724.618956:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa9774330 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774337 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790724.618968:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa9774330 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774337 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790724.618980:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787790724.618983:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff931a493ae800 from 7 10000000:01000000:3.0:1787790724.618986:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787790724.619023:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a82152200/0x70647b5fa977433e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790724.619033:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a82152200/0x70647b5fa977433e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790724.619055:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a82152200/0x70647b5fa977433e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790724.619081:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a465b4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253320576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787790724.619152:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790724.619203:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b64a600 going to sleep for 11 seconds 00000100:00100000:2.0:1787790724.619282:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253320576 00000100:00100000:2.0:1787790724.619290:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253320576 00000100:00100000:2.0:1787790724.619349:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787790724.619358:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253320576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790724.619371:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790724.619383:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a542f0a00/0x70647b5fa9774345 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa977433e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790724.619406:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a542f0a00/0x70647b5fa9774345 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa977433e expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790724.619428:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a542f0a00/0x70647b5fa9774345 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa977433e expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790724.619437:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f0a00, rc 0) 00000100:00100000:2.0:1787790724.619482:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253320576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790724.619489:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787790724.619531:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a465b4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253320576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790724.619545:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a82152200/0x70647b5fa977433e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774345 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790724.619555:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a82152200/0x70647b5fa977433e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9774345 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790724.619605:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d790000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253320704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790724.619628:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790724.619647:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a43a1c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787790724.619659:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253320704 00000100:00100000:2.0:1787790724.619662:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253320704 00000100:00100000:2.0:1787790724.619681:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787790724.619686:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253320704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790724.620514:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253320704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 825us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790724.620523:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787790724.620707:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d790000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253320704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790724.620770:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a465b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253320832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790724.620823:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790724.620855:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b64a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787790724.621291:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253320832 00000100:00100000:2.0:1787790724.621297:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253320832 00000100:00100000:2.0:1787790724.621393:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787790724.621401:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253320832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790724.621576:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253320832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790724.621583:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787790724.621695:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a465b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253320832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787790724.623205:0:11180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787790724.627142:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787790724.627170:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787790724.627183:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a82152200/0x70647b5fa977433e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774345 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790724.627195:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a82152200/0x70647b5fa977433e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774345 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790724.627206:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787790724.627209:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff931a4977d000 from 7 10000000:01000000:0.0:1787790724.627212:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787790724.627272:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa977434c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790724.627281:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa977434c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790724.627293:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa977434c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790724.627321:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5f900b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253320960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787790724.627394:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790724.627438:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a48ea1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790724.627899:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253320960 00000100:00100000:2.0:1787790724.627907:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253320960 00000100:00100000:2.0:1787790724.627956:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787790724.627966:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253320960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790724.627979:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790724.627993:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a542f0200/0x70647b5fa9774353 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa977434c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790724.628020:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a542f0200/0x70647b5fa9774353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa977434c expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790724.628032:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a542f0200/0x70647b5fa9774353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa977434c expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790724.628040:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f0200, rc 0) 00000100:00100000:2.0:1787790724.628095:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:5843:x1874634253320960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790724.628102:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787790724.628156:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5f900b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253320960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790724.628172:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa977434c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774353 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790724.628182:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa977434c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9774353 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790724.628255:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a47928780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253321088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790724.628285:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790724.628309:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a48c0b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790724.629510:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253321088 00000100:00100000:2.0:1787790724.629519:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253321088 00000100:00100000:2.0:1787790724.629560:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787790724.629568:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:5843:x1874634253321088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790724.629904:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:5843:x1874634253321088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 336us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790724.629912:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787790724.629956:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a47928780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253321088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790724.629998:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d790000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253321216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790724.630039:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790724.630056:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b9f6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790724.630068:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253321216 00000100:00100000:2.0:1787790724.630072:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253321216 00000100:00100000:2.0:1787790724.630086:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787790724.630091:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:5843:x1874634253321216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790724.630222:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:5843:x1874634253321216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790724.630229:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787790724.630263:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d790000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253321216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787790724.630928:0:11181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787790724.630983:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787790724.631001:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787790724.631011:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa977434c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774353 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790724.631021:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa977434c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774353 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790724.783280:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790724.783330:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236508672 00000100:00100000:3.0:1787790724.783340:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236508672 00000100:00100000:3.0:1787790724.785067:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 236 00000100:00100000:3.0:1787790724.785090:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+11:5585:x1874634236508672:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790724.785109:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790724.785129:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a82152600/0x70647b5fa977435a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496e9fe expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790724.785159:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a82152600/0x70647b5fa977435a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9fe expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790724.785169:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a82152600/0x70647b5fa977435a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9fe expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790724.785179:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82152600, rc 0) 00000100:00100000:3.0:1787790724.785255:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+12:5585:x1874634236508672:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 175us (1985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790724.785262:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 236 00000100:00100000:1.0:1787790724.791549:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790724.794060:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236508800 00000100:00100000:3.0:1787790724.794072:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236508800 00000100:00100000:3.0:1787790724.794133:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 237 00000100:00100000:3.0:1787790724.794143:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+12:5585:x1874634236508800:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790724.794541:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+12:5585:x1874634236508800:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 398us (2998us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790724.794549:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 237 00000100:00100000:3.0:1787790724.798548:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790724.798623:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236508928 00000100:00100000:0.0:1787790724.798632:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236508928 00000100:00100000:0.0:1787790724.798700:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 238 00000100:00100000:0.0:1787790724.798717:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+12:5585:x1874634236508928:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790724.799886:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+12:5585:x1874634236508928:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 Request processed in 1165us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790724.799898:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 238 00000100:00100000:2.0:1787790724.812845:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790724.813039:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236509056 00000100:00100000:3.0:1787790724.813050:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236509056 00000100:00100000:3.0:1787790724.813100:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 239 00000100:00100000:3.0:1787790724.813110:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+12:5585:x1874634236509056:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790724.813129:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790724.813150:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a82152000/0x70647b5fa9774361 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790724.813180:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a82152000/0x70647b5fa9774361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea05 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790724.813193:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a82152000/0x70647b5fa9774361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea05 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790724.813203:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82152000, rc 0) 00000100:00100000:3.0:1787790724.813277:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+13:5585:x1874634236509056:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 167us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790724.813293:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 239 00000100:00100000:3.0:1787790724.815667:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790724.821958:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236509184 00000100:00100000:0.0:1787790724.821974:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236509184 00000100:00100000:0.0:1787790724.822079:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 240 00000100:00100000:0.0:1787790724.822090:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+13:5585:x1874634236509184:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790724.822403:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+13:5585:x1874634236509184:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 314us (6744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790724.822412:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 240 00000100:00100000:1.0:1787790724.828027:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790724.828148:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236509312 00000100:00100000:0.0:1787790724.828159:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236509312 00000100:00100000:0.0:1787790724.828293:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 241 00000100:00100000:0.0:1787790724.828304:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+13:5585:x1874634236509312:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790724.828517:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+13:5585:x1874634236509312:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 Request processed in 214us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790724.828525:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 241 00010000:00010000:0.0:1787790724.865995:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790725.887933:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790726.065436:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790726.065475:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790726.065497:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790726.065524:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236509568 00000100:00100000:3.0:1787790726.065534:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236509568 00000100:00100000:3.0:1787790726.065587:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236509696 00000100:00100000:3.0:1787790726.065590:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236509696 00000100:00100000:3.0:1787790726.065615:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 87 00000100:00100000:3.0:1787790726.065626:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2348:x1874634236509568:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790726.065697:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2348:x1874634236509568:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 74us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790726.065705:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 87 00000100:00100000:3.0:1787790726.065743:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 88 00000100:00100000:3.0:1787790726.065750:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2348:x1874634236509696:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790726.065774:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2348:x1874634236509696:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 25us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790726.065781:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 88 00000100:00100000:3.0:1787790726.065797:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236509440 00000100:00100000:3.0:1787790726.065813:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236509440 00000100:00100000:3.0:1787790726.065844:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 242 00000100:00100000:3.0:1787790726.065851:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:2348:x1874634236509440:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790726.065874:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:2348:x1874634236509440:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 24us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790726.065890:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 242 00000100:00080000:3.0:1787790726.065915:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787790726.913590:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787790727.020283:0:11353:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787790727.938555:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790728.256135:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790728.256159:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a465b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253321344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790728.256227:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790728.256288:0:8510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253321344 00000100:00100000:3.0:1787790728.256295:0:8510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253321344 00000100:00100000:3.0:1787790728.256358:0:8510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787790728.256368:0:8510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253321344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790728.256402:0:8510:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790728.256447:0:8510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253321344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790728.256454:0:8510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1787790728.256593:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787790728.260540:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a465b5680 x1874634253321344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790728.260574:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a465b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253321344:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787790728.962775:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790729.279983:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787790729.280012:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a47928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253321472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790729.280083:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790729.280202:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253321472 00000100:00100000:1.0:1787790729.280209:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253321472 00000100:00080000:3.0:1787790729.280264:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790729.280273:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787790729.280283:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5f902580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253321472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787790729.280333:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787790729.280390:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5f902580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253321472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790729.280397:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787790729.280557:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a47928000 x1874634253321472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790729.280585:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a47928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253321472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790729.281464:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a479292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253321984:0@lo:400:kworker.0 00000100:00100000:2.0:1787790729.281467:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a47928b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253321728:0@lo:400:kworker.0 00000100:00100000:0.0:1787790729.281536:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a47928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253321600:0@lo:400:kworker.0 00000100:00100000:2.0:1787790729.282015:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790729.282049:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787790729.282055:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4792a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253321856:0@lo:400:kworker.0 00000100:00100000:2.0:1787790729.282079:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790729.282114:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253321728 00000100:00100000:2.0:1787790729.282120:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253321728 00000100:00100000:2.0:1787790729.282156:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253321856 00000100:00100000:2.0:1787790729.282159:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253321856 00000100:00100000:2.0:1787790729.282187:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787790729.282195:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253321728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790729.282252:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253321728:12345-0@lo:400:kworker.0 Request processed in 57us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790729.282260:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787790729.282276:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787790729.282283:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d793840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253321856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790729.282329:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d793840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253321856:12345-0@lo:400:kworker.0 Request processed in 46us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790729.282335:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1787790729.282359:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790729.282383:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4792a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253321856:0@lo:400:kworker.0 00000100:00100000:2.0:1787790729.282394:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a47928b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253321728:0@lo:400:kworker.0 00000100:00100000:0.0:1787790729.284447:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790729.284505:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a47928780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1874634253322112:0@lo:400:kworker.0 00000100:00100000:0.0:1787790729.284543:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790729.284851:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253321600 00000100:00100000:2.0:1787790729.284858:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253321600 00000100:00100000:2.0:1787790729.284906:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787790729.284915:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3321:x1874634253321600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790729.284964:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3321:x1874634253321600:12345-0@lo:400:kworker.0 Request processed in 50us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790729.284972:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787790729.285006:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253322112 00000100:00100000:2.0:1787790729.285010:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253322112 00000100:00100000:2.0:1787790729.285045:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787790729.285052:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5f900780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874634253322112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790729.285083:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5f900780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874634253322112:12345-0@lo:400:kworker.0 Request processed in 32us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790729.285090:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1787790729.285110:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790729.285474:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a47928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253321600:0@lo:400:kworker.0 00000100:00100000:0.0:1787790729.285487:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a47928780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1874634253322112:0@lo:400:kworker.0 00000100:00100000:3.0:1787790729.285677:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790729.285930:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253321984 00000100:00100000:2.0:1787790729.285935:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253321984 00000100:00100000:2.0:1787790729.286009:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787790729.286018:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253321984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790729.286066:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253321984:12345-0@lo:400:kworker.0 Request processed in 50us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790729.286072:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1787790729.286127:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a479292c0 x1874634253321984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790729.286149:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a479292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253321984:0@lo:400:kworker.0 00010000:00010000:0.0:1787790729.984100:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787790730.340548:0:11453:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 20:32:09 (1787790729) === 00000100:00100000:0.0:1787790730.549301:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790730.549388:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790730.549523:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236509952 00000100:00100000:3.0:1787790730.549533:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236509952 00000100:00080000:0.0:1787790730.549592:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790730.549625:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:3.0:1787790730.549707:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5f903840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:9686:x1874634236509952:12345-192.168.201.25@tcp:700:mkdir.0 00000100:00100000:3.0:1787790730.549820:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5f903840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:9686:x1874634236509952:12345-192.168.201.25@tcp:700:mkdir.0 Request processed in 186us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790730.549838:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:2.0:1787790730.550026:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236509824 00000100:00100000:2.0:1787790730.550031:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236509824 00000100:00100000:2.0:1787790730.550070:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:2.0:1787790730.550078:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5f9021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2346:x1874634236509824:12345-192.168.201.25@tcp:41:mkdir.0 00000004:00000024:2.0:1787790730.550113:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787790730.550179:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5f9021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2346:x1874634236509824:12345-192.168.201.25@tcp:41:mkdir.0 Request processed in 102us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790730.550186:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:3.0:1787790730.552166:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790730.552248:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236510208 00000100:00100000:2.0:1787790730.552255:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236510208 00000100:00100000:2.0:1787790730.552359:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:2.0:1787790730.552367:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:9686:x1874634236510208:12345-192.168.201.25@tcp:36:mkdir.0 00010000:00010000:2.0:1787790730.552410:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790730.552436:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a52849200/0x70647b5fa9774249 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e987 expref: 6 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.552467:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a541adf00) 00010000:00010000:2.0:1787790730.552479:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790730.552842:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa9774368 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.552856:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa9774368 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.552866:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa9774368 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.552879:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977436f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.552885:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977436f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.552892:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977436f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790730.554148:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787790730.554160:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa9774368 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.554166:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa9774368 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.554171:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa9774368 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.554175:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f0c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790730.554178:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa9774368 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.554184:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa9774368 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.554194:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:2.0:1787790730.554195:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790730.554198:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa9774368 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.554204:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa9774368 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787790730.554221:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000271a8e33 reply state 00000000a7fb5ac1 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977436f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790730.554230:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787790730.554328:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:9686:x1874634236510208:12345-192.168.201.25@tcp:36:mkdir.0 Request processed in 1959us (2168us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787790730.554342:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00010000:00010000:1.0:1787790730.556970:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977436f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.556988:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977436f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.556997:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977436f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.557003:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f1200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790730.557008:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977436f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.557016:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977436f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.557033:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff931a4b7e7800) 00010000:00010000:1.0:1787790730.557036:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790730.557041:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977436f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.557048:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977436f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790730.563418:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790730.563523:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236510336 00000100:00100000:2.0:1787790730.563531:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236510336 00000100:00100000:2.0:1787790730.563597:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:2.0:1787790730.563615:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:9687:x1874634236510336:12345-192.168.201.25@tcp:101:chmod.0 00010000:00010000:2.0:1787790730.563645:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790730.563669:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1800/0x70647b5fa9774376 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea0c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.563888:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa977437d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.563911:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa977437d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.563922:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa977437d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790730.563982:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787790730.563987:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787790730.564031:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa977437d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.564059:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1800/0x70647b5fa9774376 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea0c expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.564077:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa977437d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea0c expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.564103:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a4b7e7600) 00010000:00010000:2.0:1787790730.564106:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790730.564110:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f0600, rc 0) 00000100:00100000:2.0:1787790730.564208:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:9687:x1874634236510336:12345-192.168.201.25@tcp:101:chmod.0 Request processed in 602us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790730.564217:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:0.0:1787790730.573072:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790730.573174:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236510592 00000100:00100000:2.0:1787790730.573185:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236510592 00000100:00100000:2.0:1787790730.573290:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:2.0:1787790730.573301:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5f902d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:9687:x1874634236510592:12345-192.168.201.25@tcp:36:chmod.0 00010000:00010000:2.0:1787790730.573366:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790730.573394:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa977437d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea0c expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.573413:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a4b7e7600) 00010000:00010000:2.0:1787790730.573422:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790730.573447:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa9774384 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.573471:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa9774384 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.573481:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa9774384 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787790730.573871:0:7920:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001651dde2 reply state 00000000f5f2a8b7 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa9774384 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790730.573893:0:7920:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787790730.573919:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787790730.574012:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5f902d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:9687:x1874634236510592:12345-192.168.201.25@tcp:36:chmod.0 Request processed in 712us (949us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787790730.574019:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00010000:00010000:2.0:1787790730.576103:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa9774384 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.576116:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa9774384 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.576121:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa9774384 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.576125:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f1200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790730.576128:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa9774384 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.576133:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa9774384 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.576143:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a4b7e7300) 00010000:00010000:2.0:1787790730.576145:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787790730.576149:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa9774384 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.576152:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa9774384 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790730.597918:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790730.598024:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236510720 00000100:00100000:2.0:1787790730.598047:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236510720 00000100:00100000:2.0:1787790730.598113:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:2.0:1787790730.598123:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5f901e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:9688:x1874634236510720:12345-192.168.201.25@tcp:101:chown.0 00010000:00010000:2.0:1787790730.598148:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790730.598172:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977438b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea13 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.598306:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa9774392 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.598323:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa9774392 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.598336:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa9774392 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790730.598398:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787790730.598401:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787790730.598502:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa9774392 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.598541:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977438b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea13 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.598560:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa9774392 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea13 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.598568:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a4b7e7300) 00010000:00010000:2.0:1787790730.598571:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790730.598672:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f0600, rc 0) 00000100:00100000:2.0:1787790730.598881:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5f901e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:9688:x1874634236510720:12345-192.168.201.25@tcp:101:chown.0 Request processed in 757us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790730.598889:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:3.0:1787790730.601692:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790730.601818:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236510848 00000100:00100000:0.0:1787790730.601828:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236510848 00000100:00100000:0.0:1787790730.601898:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:0.0:1787790730.601909:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:9688:x1874634236510848:12345-192.168.201.25@tcp:101:chown.0 00010000:00010000:0.0:1787790730.601929:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790730.601952:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774399 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea1a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602019:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa97743a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602034:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa97743a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602061:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa97743a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602077:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa97743a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602084:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa97743a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602090:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa97743a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602199:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa97743ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602207:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa97743ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602214:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa97743ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790730.602395:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787790730.602398:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787790730.602420:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa97743ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602430:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa97743a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602503:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa97743a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602527:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa97743a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602534:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790730.602539:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa97743a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602548:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa97743a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602562:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a4b7e7300) 00010000:00010000:0.0:1787790730.602565:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790730.602570:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa97743a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602676:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa97743a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602690:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa97743a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602695:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa97743a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602698:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa97743a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602701:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790730.602703:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa97743a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602714:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa97743a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602879:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff931a49c31900) 00010000:00010000:0.0:1787790730.602881:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790730.602885:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa97743a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602889:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa97743a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602920:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774399 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea1a expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602934:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa97743ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea1a expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.602942:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff931a49c31b00) 00010000:00010000:0.0:1787790730.602944:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787790730.602946:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a40030a00, rc 0) 00000100:00100000:0.0:1787790730.603049:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:9688:x1874634236510848:12345-192.168.201.25@tcp:101:chown.0 Request processed in 1141us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790730.603056:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:3.0:1787790730.608681:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790730.608814:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236511104 00000100:00100000:1.0:1787790730.608836:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236511104 00000100:00100000:1.0:1787790730.608891:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:1.0:1787790730.608901:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:9688:x1874634236511104:12345-192.168.201.25@tcp:36:chown.0 00010000:00010000:1.0:1787790730.608953:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790730.608993:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa97743ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea1a expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.609010:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff931a49c31b00) 00010000:00010000:1.0:1787790730.609020:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790730.609054:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97743b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.609067:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97743b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.609076:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97743b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787790730.644080:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1787790730.644112:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048785e8c reply state 00000000434c7d87 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97743b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790730.644127:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787790730.644284:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:0.0:1787790730.644395:0:5846:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1787790730.644414:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:9688:x1874634236511104:12345-192.168.201.25@tcp:36:chown.0 Request processed in 35511us (35739us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787790730.644424:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00010000:00010000:1.0:1787790730.644505:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97743b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.644514:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97743b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.644522:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97743b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.644528:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790730.644533:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97743b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.644551:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97743b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.644569:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff931a488be800) 00010000:00010000:1.0:1787790730.644572:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787790730.644577:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97743b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.644583:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97743b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790730.669386:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790730.669505:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236511232 00000100:00100000:2.0:1787790730.669527:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236511232 00000100:00100000:2.0:1787790730.669601:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:2.0:1787790730.669610:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:9689:x1874634236511232:12345-192.168.201.25@tcp:101:touch.500 00010000:00010000:2.0:1787790730.669646:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790730.669667:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa97743bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea21 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787790730.671951:0:7920:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2235us 00010000:00010000:1.0:1787790730.683754:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97743c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.683779:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97743c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.683791:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97743c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.683806:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97743ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.683812:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97743ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.683819:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97743ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.685198:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa97743d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.685222:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa97743d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.685231:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa97743d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790730.685345:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787790730.685349:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787790730.685428:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa97743d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.685450:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97743c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.685459:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97743c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.685464:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97743c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.685469:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790730.685471:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97743c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.685476:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97743c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.685486:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a4b7e7300) 00010000:00010000:1.0:1787790730.685488:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790730.685492:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97743c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.685503:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97743c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.685885:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97743ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.685894:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97743ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.685900:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97743ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.685905:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790730.685908:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97743ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.685914:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97743ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.685923:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff931a488be800) 00010000:00010000:1.0:1787790730.685926:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790730.685929:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97743ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.685935:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97743ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.685977:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa97743bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea21 expref: 8 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.685998:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa97743d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea21 expref: 7 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.686013:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff931a488be700) 00010000:00010000:1.0:1787790730.686015:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787790730.686018:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45704a00, rc 0) 00000100:00100000:1.0:1787790730.686088:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:9689:x1874634236511232:12345-192.168.201.25@tcp:101:touch.500 Request processed in 16477us (16709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790730.686098:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:3.0:1787790730.689042:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790730.689216:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236511488 00000100:00100000:2.0:1787790730.689226:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236511488 00000100:00100000:2.0:1787790730.689289:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:2.0:1787790730.689300:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:9689:x1874634236511488:12345-192.168.201.25@tcp:101:touch.500 00010000:00010000:2.0:1787790730.689393:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790730.689417:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1800/0x70647b5fa97743d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea28 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.690056:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa97743df lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.690069:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa97743df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.690078:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa97743df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.690148:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97743e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.690154:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97743e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.690159:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97743e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787790730.691279:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1787790730.692248:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa97743ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.692264:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa97743ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.692274:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa97743ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.692323:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa97743df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.692331:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa97743df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.692338:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa97743df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.692344:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f0c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790730.692348:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa97743df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.692369:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa97743df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.692383:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff931a488be700) 00010000:00010000:2.0:1787790730.692386:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790730.692391:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa97743df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.692397:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa97743df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787790730.692409:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c98ece2 reply state 00000000ed760c97 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97743e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790730.692418:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787790730.692466:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1800/0x70647b5fa97743d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea28 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.692482:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa97743ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea28 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.692490:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff931a4b7e7600) 00010000:00010000:2.0:1787790730.692492:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790730.692494:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654fe00, rc 0) 00000100:00100000:2.0:1787790730.692580:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+10:9689:x1874634236511488:12345-192.168.201.25@tcp:101:touch.500 Request processed in 3273us (3541us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787790730.692590:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 22 00010000:00010000:1.0:1787790730.696107:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97743e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.696126:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97743e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.696134:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97743e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.696140:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654ea00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790730.696144:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97743e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.696153:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97743e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.696169:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x60d7aa11 (ffff931a4b7e7d00) 00010000:00010000:1.0:1787790730.696173:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790730.696177:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97743e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790730.696183:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97743e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790730.698411:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790730.698625:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236511744 00000100:00100000:0.0:1787790730.698635:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236511744 00000100:00100000:0.0:1787790730.698697:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:0.0:1787790730.698707:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:9689:x1874634236511744:12345-192.168.201.25@tcp:36:touch.500 00010000:00010000:0.0:1787790730.698798:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790730.698823:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa97743ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea28 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.698846:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff931a4b7e7600) 00010000:00010000:0.0:1787790730.698854:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787790730.698891:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97743fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.698901:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97743fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.698911:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97743fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790730.699031:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009206edb8 reply state 000000003b4862ae transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97743fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790730.699038:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787790730.699117:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+10:9689:x1874634236511744:12345-192.168.201.25@tcp:36:touch.500 Request processed in 412us (715us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787790730.699123:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 23 00010000:00010000:2.0:1787790730.701136:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97743fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.701164:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97743fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.701170:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97743fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.701175:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40031400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790730.701180:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97743fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.701186:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97743fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.701265:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff931a49c31600) 00010000:00010000:2.0:1787790730.701268:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790730.701272:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97743fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.701278:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97743fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790730.703015:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790730.703113:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236511872 00000100:00100000:0.0:1787790730.703123:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236511872 00000100:00100000:0.0:1787790730.703182:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:0.0:1787790730.703240:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:9689:x1874634236511872:12345-192.168.201.25@tcp:101:touch.500 00010000:00010000:0.0:1787790730.703262:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790730.703278:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa9774402 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea2f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.703353:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa9774402 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea2f expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.703363:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa9774402 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea2f expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.703376:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff931a49c31900) 00010000:00010000:0.0:1787790730.703378:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787790730.703381:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a40030e00, rc 0) 00000100:00100000:0.0:1787790730.703429:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+10:9689:x1874634236511872:12345-192.168.201.25@tcp:101:touch.500 Request processed in 240us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790730.703437:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:3.0:1787790730.707884:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790730.707973:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236512000 00000100:00100000:2.0:1787790730.707983:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236512000 00000100:00100000:2.0:1787790730.708086:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:2.0:1787790730.708095:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1874634236512000:12345-192.168.201.25@tcp:8:touch.500 00010000:00080000:2.0:1787790730.708140:0:6685:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:2.0:1787790730.708183:0:6685:0:(genops.c:1385:class_connect()) connect: client 3e6e059d-f39a-42a8-9e93-fd30a950cc49, cookie 0x70647b5fa9774409 00002000:00100000:2.0:1787790730.708195:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3e6e059d-f39a-42a8-9e93-fd30a950cc49/ffff931a5fca4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787790730.708234:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787790730.708481:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787790730.708519:0:6685:0:(import.c:65:import_set_state_nolock()) ffff931a5fca5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787790730.708601:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2345:x1874634236512000:12345-192.168.201.25@tcp:8:touch.500 Request processed in 504us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790730.708609:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:3.0:1787790730.711472:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790730.711743:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236512128 00000100:00100000:0.0:1787790730.711753:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236512128 00000100:00080000:2.0:1787790730.711818:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790730.711825:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:0.0:1787790730.711836:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:0:x1874634236512128:12345-192.168.201.25@tcp:2:touch.500 00000001:00080000:0.0:1787790730.754818:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:0.0:1787790730.754835:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3e6e059d-f39a-42a8-9e93-fd30a950cc49 00000100:00100000:3.0:1787790730.755109:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:0:x1874634236512128:12345-192.168.201.25@tcp:2:touch.500 Request processed in 43270us (43640us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787790730.755121:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:3.0:1787790730.758855:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790730.759034:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236512384 00000100:00100000:2.0:1787790730.759044:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236512384 00000100:00100000:2.0:1787790730.759105:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:2.0:1787790730.759115:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+10:9689:x1874634236512384:12345-192.168.201.25@tcp:35:touch.500 00000100:00100000:2.0:1787790730.759464:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+11:9689:x1874634236512384:12345-192.168.201.25@tcp:35:touch.500 Request processed in 349us (615us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787790730.759472:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:0.0:1787790730.772123:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790730.772404:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236512512 00000100:00100000:2.0:1787790730.772415:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236512512 00000100:00100000:2.0:1787790730.772479:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:2.0:1787790730.772490:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5f902940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+11:9690:x1874634236512512:12345-192.168.201.25@tcp:101:rm.0 00010000:00010000:2.0:1787790730.772515:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790730.772535:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774410 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea36 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.772600:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e800/0x70647b5fa9774417 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.772614:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e800/0x70647b5fa9774417 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.772636:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e800/0x70647b5fa9774417 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790730.772693:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787790730.772697:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787790730.773051:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e800/0x70647b5fa9774417 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.773081:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774410 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea36 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.773099:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e800/0x70647b5fa9774417 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea36 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.773106:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff931a488be700) 00010000:00010000:3.0:1787790730.773109:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787790730.773119:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654e800, rc 0) 00000100:00100000:3.0:1787790730.773228:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5f902940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+12:9690:x1874634236512512:12345-192.168.201.25@tcp:101:rm.0 Request processed in 739us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790730.773237:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:1.0:1787790730.777160:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790730.777584:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236512768 00000100:00100000:2.0:1787790730.777594:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236512768 00000100:00100000:2.0:1787790730.777697:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:2.0:1787790730.777708:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4792ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+12:9690:x1874634236512768:12345-192.168.201.25@tcp:101:rm.0 00010000:00010000:2.0:1787790730.777769:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790730.777791:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f800/0x70647b5fa977441e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea3d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790730.777910:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787790730.778074:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f800/0x70647b5fa977441e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea3d expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.778089:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a4b7e7300) 00010000:00010000:2.0:1787790730.778092:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787790730.778098:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f800/0x70647b5fa977441e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea3d expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.778111:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654f800, rc 0) 00000100:00100000:2.0:1787790730.778170:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4792ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+13:9690:x1874634236512768:12345-192.168.201.25@tcp:101:rm.0 Request processed in 464us (1019us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787790730.778178:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:0.0:1787790730.782660:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790730.782958:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236512896 00000100:00100000:2.0:1787790730.782980:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236512896 00000100:00100000:2.0:1787790730.783035:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:2.0:1787790730.783045:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5f903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+13:9690:x1874634236512896:12345-192.168.201.25@tcp:37:rm.0 00000100:00100000:2.0:1787790730.787559:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5f903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+13:9690:x1874634236512896:12345-192.168.201.25@tcp:37:rm.0 Request processed in 4505us (4899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790730.787573:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:1.0:1787790730.791030:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790730.791132:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236513152 00000100:00100000:3.0:1787790730.791141:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236513152 00000100:00100000:3.0:1787790730.791341:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:3.0:1787790730.791352:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4a6ba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+13:9690:x1874634236513152:12345-192.168.201.25@tcp:35:rm.0 00000100:00100000:3.0:1787790730.791593:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4a6ba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+14:9690:x1874634236513152:12345-192.168.201.25@tcp:35:rm.0 Request processed in 241us (570us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787790730.791600:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:0.0:1787790730.794837:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790730.794992:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236513408 00000100:00100000:2.0:1787790730.795001:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236513408 00000100:00100000:2.0:1787790730.795055:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:2.0:1787790730.795065:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5f903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+14:9690:x1874634236513408:12345-192.168.201.25@tcp:101:rm.0 00010000:00010000:2.0:1787790730.795086:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790730.795103:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f800/0x70647b5fa977442c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea44 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.795222:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774433 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.795237:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774433 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.795247:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774433 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790730.795259:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787790730.795865:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f800/0x70647b5fa977442c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea44 expref: 17 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.795881:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774433 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea44 expref: 16 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.795954:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff931a488be700) 00010000:00010000:2.0:1787790730.795957:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787790730.795960:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654f200, rc 0) 00000100:00100000:2.0:1787790730.796020:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5f903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+16:9690:x1874634236513408:12345-192.168.201.25@tcp:101:rm.0 Request processed in 956us (1191us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787790730.796028:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:0.0:1787790730.799519:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790730.799588:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236513536 00000100:00100000:1.0:1787790730.799597:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236513536 00000100:00100000:1.0:1787790730.799716:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:1.0:1787790730.799811:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5f900b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+16:9690:x1874634236513536:12345-192.168.201.25@tcp:41:rm.0 00000004:00000024:1.0:1787790730.799870:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1787790730.799940:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5f900b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+16:9690:x1874634236513536:12345-192.168.201.25@tcp:41:rm.0 Request processed in 133us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790730.799948:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:1.0:1787790730.801852:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790730.801880:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236513664 00000100:00100000:3.0:1787790730.801887:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236513664 00000100:00100000:3.0:1787790730.801945:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 29 00000100:00100000:3.0:1787790730.801953:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4792b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+16:9690:x1874634236513664:12345-192.168.201.25@tcp:101:rm.0 00010000:00010000:3.0:1787790730.801969:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790730.801988:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774441 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea4b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802045:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774448 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802059:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774448 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802071:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774448 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802084:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa977444f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802102:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa977444f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802109:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa977444f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802250:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774456 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802259:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802266:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790730.802305:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787790730.802310:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787790730.802327:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802339:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802348:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774448 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802355:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774448 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802362:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774448 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802376:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790730.802381:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774448 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802388:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774448 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802398:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff931a488be700) 00010000:00010000:3.0:1787790730.802400:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790730.802405:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774448 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802411:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774448 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802422:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa977444f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802428:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa977444f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802433:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa977444f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802438:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790730.802441:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa977444f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802445:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa977444f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802459:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x60d7aa11 (ffff931a541adf00) 00010000:00010000:3.0:1787790730.802461:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790730.802464:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa977444f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802469:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa977444f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802494:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774441 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea4b expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802506:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774456 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea4b expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790730.802512:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff931a49c31900) 00010000:00010000:3.0:1787790730.802514:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787790730.802516:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153600, rc 0) 00000100:00100000:3.0:1787790730.802569:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4792b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+17:9690:x1874634236513664:12345-192.168.201.25@tcp:101:rm.0 Request processed in 618us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790730.802576:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 29 00000100:00100000:3.0:1787790730.805420:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790730.805502:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236513920 00000100:00100000:2.0:1787790730.805511:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236513920 00000100:00100000:2.0:1787790730.805562:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 30 00000100:00100000:2.0:1787790730.805570:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+17:9690:x1874634236513920:12345-192.168.201.25@tcp:36:rm.0 00010000:00010000:2.0:1787790730.805619:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787790730.805644:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774456 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea4b expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.805666:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa9774402 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea2f expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.805677:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff931a49c31900) 00010000:00010000:2.0:1787790730.805692:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e800/0x70647b5fa9774417 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea36 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.805700:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff931a488be700) 00010000:00010000:2.0:1787790730.805703:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790730.805767:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f800/0x70647b5fa977445d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.805798:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f800/0x70647b5fa977445d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.805809:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f800/0x70647b5fa977445d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.805825:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774464 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.805832:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774464 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.805846:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774464 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.806029:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa977446b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.806038:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa977446b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.806045:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa977446b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787790730.806714:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787790730.806759:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 265687034760ns, next at 266687032105ns, rc = 0 00010000:00010000:2.0:1787790730.806815:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774472 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.806825:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774472 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.806843:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774472 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.806851:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774472 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.806857:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774472 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.806863:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774472 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.806889:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787790730.807390:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa977446b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.807399:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa977446b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.807405:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa977446b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.807411:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654ee00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790730.807416:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa977446b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.807424:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa977446b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.807435:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff931a4b7e7200) 00010000:00010000:2.0:1787790730.807439:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787790730.807451:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa977446b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.807457:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa977446b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.807475:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f800/0x70647b5fa977445d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.807482:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f800/0x70647b5fa977445d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.807489:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f800/0x70647b5fa977445d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.807494:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790730.807497:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f800/0x70647b5fa977445d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.807503:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f800/0x70647b5fa977445d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.807511:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff931a488be700) 00010000:00010000:2.0:1787790730.807513:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790730.807516:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f800/0x70647b5fa977445d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.807521:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f800/0x70647b5fa977445d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787790730.807529:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d3740dd reply state 00000000f433fa77 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774464 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790730.807549:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787790730.807637:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+16:9690:x1874634236513920:12345-192.168.201.25@tcp:36:rm.0 Request processed in 2063us (2220us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787790730.807645:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 30 00010000:00010000:0.0:1787790730.809465:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790730.809478:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774472 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.809489:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654fc00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:0.0:1787790730.809493:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774472 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.809502:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774472 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.809517:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff931a4b7e7200) 00010000:00010000:0.0:1787790730.809520:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787790730.809524:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774472 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.809530:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774472 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.809551:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790730.809553:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790730.809554:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790730.810995:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774464 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.811009:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774464 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.811016:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774464 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.811022:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790730.811027:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774464 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.811034:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774464 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.811046:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x60d7aa11 (ffff931a4b7e7500) 00010000:00010000:2.0:1787790730.811049:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790730.811053:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774464 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.811059:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774464 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790730.813842:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790730.813891:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236514176 00000100:00100000:1.0:1787790730.813902:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236514176 00000100:00100000:1.0:1787790730.814070:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:1.0:1787790730.814082:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+15:9690:x1874634236514176:12345-192.168.201.25@tcp:35:rm.0 00000100:00100000:1.0:1787790730.814821:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+16:9690:x1874634236514176:12345-192.168.201.25@tcp:35:rm.0 Request processed in 739us (986us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787790730.814831:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:3.0:1787790730.816550:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790730.816697:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236514432 00000100:00100000:0.0:1787790730.816706:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236514432 00000100:00100000:0.0:1787790730.816781:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:0.0:1787790730.816791:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+16:9690:x1874634236514432:12345-192.168.201.25@tcp:36:rm.0 00010000:00010000:0.0:1787790730.816845:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787790730.816871:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774433 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea44 expref: 16 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.817026:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa97743d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea21 expref: 15 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.817038:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff931a488be700) 00010000:00010000:0.0:1787790730.817052:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa9774392 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea13 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.817060:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a4b7e7300) 00010000:00010000:0.0:1787790730.817066:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787790730.817092:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa9774479 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.817102:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa9774479 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.817112:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa9774479 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.817122:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774480 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.817129:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774480 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.817135:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774480 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.817585:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774487 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.817607:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774487 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.817614:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774487 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790730.819000:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787790730.819023:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774487 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.819032:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774487 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.819038:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774487 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.819044:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40031400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790730.819048:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774487 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.819055:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774487 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.819068:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff931a49c31500) 00010000:00010000:0.0:1787790730.819071:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787790730.819075:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774487 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.819081:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774487 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.819100:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa9774479 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.819109:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa9774479 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.819113:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa9774479 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.819116:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790730.819117:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa9774479 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.819121:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa9774479 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.819126:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a49c31700) 00010000:00010000:0.0:1787790730.819127:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790730.819129:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa9774479 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790730.819132:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa9774479 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790730.819140:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6a02a86 reply state 0000000012c10fb0 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774480 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790730.819145:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787790730.819311:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+15:9690:x1874634236514432:12345-192.168.201.25@tcp:36:rm.0 Request processed in 2519us (2764us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787790730.819329:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 31 00010000:00010000:2.0:1787790730.821117:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774480 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.821145:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774480 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.821152:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774480 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.821157:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790730.821161:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774480 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.821167:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774480 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.821180:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff931a49c31f00) 00010000:00010000:2.0:1787790730.821183:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790730.821187:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774480 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790730.821193:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774480 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790731.008080:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790731.184811:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790731.185002:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236514560 00000100:00100000:0.0:1787790731.185035:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236514560 00000100:00100000:0.0:1787790731.185114:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 244 00000100:00100000:0.0:1787790731.185124:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+13:2349:x1874634236514560:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790731.186028:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+13:2349:x1874634236514560:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 900us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790731.186039:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 244 00000100:00100000:3.0:1787790731.188875:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790731.191418:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236514688 00000100:00100000:0.0:1787790731.191443:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236514688 00000100:00100000:0.0:1787790731.191543:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 92 00000100:00100000:0.0:1787790731.191555:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2349:x1874634236514688:12345-192.168.201.25@tcp:400:kworker.0 00000100:00080000:2.0:1787790731.192006:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790731.192075:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2349:x1874634236514688:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 521us (3210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790731.192084:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 92 00010000:00010000:0.0:1787790732.035837:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790733.056075:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787790733.376192:0:6791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 268256464865ns, next at 269256460389ns, rc = 0 00000100:00100000:0.0:1787790733.376192:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790733.376231:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4794e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253322240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787790733.376465:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790733.376663:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253322240 00000100:00100000:2.0:1787790733.376671:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253322240 00000100:00100000:2.0:1787790733.376845:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787790733.376856:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5f901a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253322240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787790733.376898:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787790733.376954:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5f901a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253322240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790733.376977:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787790733.377165:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787790733.377666:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a4794e580 x1874634253322240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790733.377762:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4794e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253322240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787790734.089106:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790734.402286:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4794c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253322368:0@lo:400:kworker.0 00000100:00100000:3.0:1787790734.402359:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790734.402407:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4794d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253322880:0@lo:400:kworker.0 00000100:00100000:3.0:1787790734.402435:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790734.402475:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787790734.402481:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4794cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253322752:0@lo:400:kworker.0 00000100:00100000:3.0:1787790734.402532:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790734.402572:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4794fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253322496:0@lo:400:kworker.0 00000100:00100000:3.0:1787790734.402603:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790734.403356:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253322752 00000100:00100000:1.0:1787790734.403364:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253322752 00000100:00100000:3.0:1787790734.403917:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4794f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253323008:0@lo:400:kworker.0 00000100:00100000:1.0:1787790734.404640:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787790734.404653:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253322752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790734.404765:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253322752:12345-0@lo:400:kworker.0 Request processed in 114us (2232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790734.404772:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787790734.404844:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a4794cf00 x1874634253322752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790734.404858:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4794cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253322752:0@lo:400:kworker.0 00000100:00100000:0.0:1787790734.405496:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4794cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1874634253322624:0@lo:400:kworker.0 00000100:00100000:3.0:1787790734.405504:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790734.405539:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790734.405563:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253322368 00000100:00100000:0.0:1787790734.405565:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a479283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253323136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790734.405571:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253322368 00000100:00100000:0.0:1787790734.405596:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790734.406946:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787790734.406968:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253322368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790734.407050:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253322368:12345-0@lo:400:kworker.0 Request processed in 91us (4691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790734.407057:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787790734.407092:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253322880 00000100:00100000:0.0:1787790734.407101:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253322880 00000100:00100000:0.0:1787790734.407162:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253322496 00000100:00100000:0.0:1787790734.407176:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253322496 00000100:00100000:0.0:1787790734.407192:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253322624 00000100:00100000:0.0:1787790734.407194:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253322624 00000100:00100000:0.0:1787790734.407210:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787790734.407216:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253322880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790734.407253:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253322880:12345-0@lo:400:kworker.0 Request processed in 37us (4817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790734.407259:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787790734.407271:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787790734.407277:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253322496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790734.407320:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253322496:12345-0@lo:400:kworker.0 Request processed in 28us (4701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790734.407327:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787790734.407338:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787790734.407344:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c26a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874634253322624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790734.407373:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c26a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874634253322624:12345-0@lo:400:kworker.0 Request processed in 31us (1835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790734.407378:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787790734.407396:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253323008 00000100:00100000:0.0:1787790734.407400:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253323008 00000100:00100000:0.0:1787790734.407422:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787790734.407428:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253323008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790734.407457:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253323008:12345-0@lo:400:kworker.0 Request processed in 30us (1955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790734.407462:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787790734.407511:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4794cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1874634253322624:0@lo:400:kworker.0 00000100:00080000:3.0:1787790734.407676:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787790734.407681:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790734.407708:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4794fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253322496:0@lo:400:kworker.0 00000100:00100000:1.0:1787790734.408194:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4794c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253322368:0@lo:400:kworker.0 00000100:00100000:1.0:1787790734.408207:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4794d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253322880:0@lo:400:kworker.0 00010000:00080000:3.0:1787790734.408247:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a4794f480 x1874634253323008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790734.408275:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4794f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253323008:0@lo:400:kworker.0 00000100:00100000:3.0:1787790734.410884:0:8510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253323136 00000100:00100000:3.0:1787790734.410956:0:8510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253323136 00000100:00100000:3.0:1787790734.411030:0:8510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787790734.411042:0:8510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c2683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253323136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787790734.411082:0:8510:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790734.411219:0:8510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c2683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253323136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 179us (5621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790734.411227:0:8510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1787790734.411324:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a479283c0 x1874634253323136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790734.411345:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a479283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253323136:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1787790734.414442:0:11603:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1787790735.106034:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787790735.163432:0:11651:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc946cee60 20000000:00000080:0.0:1787790735.163459:0:11651:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff931944558800 uarg=0000000000000000 20000000:01000000:0.0:1787790735.163516:0:11651:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787790735.163525:0:11651:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787790735.163531:0:11651:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787790735.171690:0:11652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1787790735.172778:0:11651:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1787790735.187608:0:11651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1787790735.187916:0:11651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1787790735.188222:0:11651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1787790735.188248:0:11651:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787790735.188274:0:11651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff931a40030a00/0x70647b5fa977448e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.188298:0:11651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a542f1000/0x70647b5fa9774337 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9774330 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.188307:0:11651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a542f0a00/0x70647b5fa9774345 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa977433e expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.188314:0:11651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a542f0200/0x70647b5fa9774353 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa977434c expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.188325:0:11651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a82152600/0x70647b5fa977435a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9fe expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.188333:0:11651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a82152000/0x70647b5fa9774361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea05 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.188343:0:11651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff931a40030a00/0x70647b5fa977448e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.188409:0:11651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a82152000/0x70647b5fa9774361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea05 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.188429:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff931a82152000/0x70647b5fa9774361 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea05 expref: 12 pid: 5840 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790735.188448:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c269680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874634253323264:192.168.201.25@tcp:104: 00010000:00010000:0.0:1787790735.188598:0:11651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a82152600/0x70647b5fa977435a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9fe expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.188608:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff931a82152600/0x70647b5fa977435a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9fe expref: 12 pid: 5841 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790735.188618:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c26b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874634253323392:192.168.201.25@tcp:104: 00010000:00010000:0.0:1787790735.188662:0:11651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a542f0200/0x70647b5fa9774353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa977434c expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.188670:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a542f0200/0x70647b5fa9774353 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa977434c expref: 18 pid: 5840 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790735.189546:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c26a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874634253323520:0@lo:104: 00000100:00100000:0.0:1787790735.189608:0:11651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787790735.189665:0:11651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a542f0a00/0x70647b5fa9774345 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa977433e expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.189675:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a542f0a00/0x70647b5fa9774345 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa977433e expref: 18 pid: 5840 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790735.189865:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c26b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874634253323648:0@lo:104: 00000100:00100000:0.0:1787790735.189891:0:11651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790735.190002:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253323520 00000100:00100000:0.0:1787790735.190011:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253323520 00000100:00100000:0.0:1787790735.190060:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253323648 00000100:00100000:0.0:1787790735.190063:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253323648 00000100:00100000:0.0:1787790735.190079:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787790735.190089:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c26b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+4:11651:x1874634253323520:12345-0@lo:104: 00010000:00010000:0.0:1787790735.190105:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa977434c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9774353 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.190171:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787790735.190177:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c26b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+4:11651:x1874634253323520:12345-0@lo:104: Request processed in 90us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790735.190185:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787790735.190306:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787790735.190317:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c268f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:11651:x1874634253323648:12345-0@lo:104: 00010000:00010000:2.0:1787790735.190326:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a82152200/0x70647b5fa977433e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9774345 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790735.190365:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787790735.190370:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c268f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:11651:x1874634253323648:12345-0@lo:104: Request processed in 57us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790735.190377:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787790735.190399:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787790735.190406:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa977434c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9774353 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790735.190414:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40031c00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:2.0:1787790735.190419:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa977434c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa9774353 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790735.190429:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa977434c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa9774353 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790735.190438:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa977434c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa9774353 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790735.190444:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787790735.190480:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa977434c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774353 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790735.190495:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790735.190536:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa977434c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774353 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790735.190545:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa977434c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774353 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790735.190561:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790735.190565:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a82152200/0x70647b5fa977433e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9774345 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790735.190570:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152200 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:2.0:1787790735.190573:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a82152200/0x70647b5fa977433e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa9774345 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790735.190579:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a82152200/0x70647b5fa977433e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa9774345 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790735.190585:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a82152200/0x70647b5fa977433e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa9774345 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790735.190589:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787790735.190602:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a82152200/0x70647b5fa977433e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774345 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790735.190607:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790735.190612:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a82152200/0x70647b5fa977433e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774345 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790735.190618:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a82152200/0x70647b5fa977433e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774345 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790735.190634:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790735.190636:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790735.190638:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790735.190653:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790735.190792:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d7921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253323776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790735.190830:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790735.190865:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787790735.190871:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d792940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253323904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790735.190906:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790735.190947:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253323776 00000100:00100000:2.0:1787790735.190953:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253323776 00010000:00010000:2.0:1787790735.190976:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a542f0200/0x70647b5fa9774353 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa977434c expref: 19 pid: 5840 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790735.191000:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253323904 00000100:00100000:2.0:1787790735.191003:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253323904 00010000:00010000:2.0:1787790735.191015:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a542f0a00/0x70647b5fa9774345 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa977433e expref: 20 pid: 5840 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790735.191033:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787790735.191040:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d793480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+20:3318:x1874634253323776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787790735.191053:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790735.191058:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a542f0200/0x70647b5fa9774353 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa977434c expref: 20 pid: 5840 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790735.191067:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a542f0200/0x70647b5fa9774353 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa977434c expref: 20 pid: 5840 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790735.191099:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790735.191129:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d793480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+20:3318:x1874634253323776:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790735.191137:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787790735.191153:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787790735.191160:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53f04780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3318:x1874634253323904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787790735.191168:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790735.191172:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a542f0a00/0x70647b5fa9774345 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa977433e expref: 19 pid: 5840 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790735.191181:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a542f0a00/0x70647b5fa9774345 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa977433e expref: 19 pid: 5840 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790735.191190:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787790735.191512:0:11651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a542f1000/0x70647b5fa9774337 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa9774330 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.191524:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff931a542f1000/0x70647b5fa9774337 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa9774330 expref: 19 pid: 5840 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790735.191534:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c268000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874634253324032:0@lo:104: 00000100:00100000:0.0:1787790735.191951:0:11651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790735.191980:0:11651:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a48c0b9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787790735.192009:0:11651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a542f0200/0x70647b5fa9774353 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa977434c expref: 19 pid: 5840 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790735.192024:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c26a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874634253323520:0@lo:104: 00010000:00010000:0.0:1787790735.192050:0:11651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a542f0a00/0x70647b5fa9774345 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa977433e expref: 18 pid: 5840 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790735.192060:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c26b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874634253323648:0@lo:104: 00000100:00100000:0.0:1787790735.192122:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c269680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874634253323264:192.168.201.25@tcp:104: 00000100:00100000:3.0:1787790735.192132:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790735.192136:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c26b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874634253323392:192.168.201.25@tcp:104: 00000100:00100000:0.0:1787790735.192272:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d7921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253323776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787790735.192298:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236514816 00000100:00100000:0.0:1787790735.192302:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236514816 00010000:00010000:0.0:1787790735.192326:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a82152000/0x70647b5fa9774361 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea05 expref: 13 pid: 5840 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790735.192344:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:0.0:1787790735.192351:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a493cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b956aedb-a574-46fa-b700-b912aca9a68a+13:2349:x1874634236514816:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790735.192361:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790735.192365:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a82152000/0x70647b5fa9774361 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea05 expref: 13 pid: 5840 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.192375:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a82152000/0x70647b5fa9774361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea05 expref: 13 pid: 5840 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.192390:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a82152000/0x70647b5fa9774361 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea05 expref: 13 pid: 5840 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.192402:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790735.192447:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a493cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b956aedb-a574-46fa-b700-b912aca9a68a+12:2349:x1874634236514816:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 96us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790735.192465:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:0.0:1787790735.192535:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787790735.192548:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253324032 00000100:00100000:0.0:1787790735.192552:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253324032 00000100:00100000:0.0:1787790735.192583:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787790735.192590:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7daff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:11651:x1874634253324032:12345-0@lo:104: 00010000:00010000:0.0:1787790735.192602:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa9774330 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9774337 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.192664:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787790735.192670:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7daff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+3:11651:x1874634253324032:12345-0@lo:104: Request processed in 82us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790735.192676:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787790735.192784:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c268000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874634253324032:0@lo:104: 00010000:00010000:0.0:1787790735.192814:0:11651:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff931a40030a00/0x70647b5fa977448e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790735.192920:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790735.192952:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236514944 00000100:00100000:3.0:1787790735.192957:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236514944 00010000:00010000:0.0:1787790735.192971:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790735.192978:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa9774330 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9774337 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790735.192980:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a82152600/0x70647b5fa977435a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9fe expref: 12 pid: 5841 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.192997:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f1400 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:0.0:1787790735.193003:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa9774330 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa9774337 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.193013:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa9774330 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa9774337 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790735.193017:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:3.0:1787790735.193029:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b956aedb-a574-46fa-b700-b912aca9a68a+12:2348:x1874634236514944:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790735.193043:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:0.0:1787790735.193046:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa9774330 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa9774337 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790735.193051:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a82152600/0x70647b5fa977435a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9fe expref: 12 pid: 5841 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790735.193058:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787790735.193072:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a82152600/0x70647b5fa977435a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9fe expref: 12 pid: 5841 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790735.193087:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a82152600/0x70647b5fa977435a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9fe expref: 12 pid: 5841 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.193098:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa9774330 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774337 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.193106:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790735.193128:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa9774330 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774337 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.193135:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a542f1400/0x70647b5fa9774330 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9774337 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.193151:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790735.193153:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790735.193154:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790735.193182:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787790735.193196:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253324160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787790735.193229:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790735.193260:0:5833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1787790735.193266:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1787790735.193403:0:8498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1787790735.193411:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253324160 00000100:00100000:0.0:1787790735.193414:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253324160 00010000:00010000:0.0:1787790735.193429:0:8498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a542f1000/0x70647b5fa9774337 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9774330 expref: 18 pid: 5840 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790735.193443:0:8498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1787790735.193449:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787790735.193462:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c26b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:3321:x1874634253324160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790735.193472:0:8498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790735.193478:0:8498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a542f1000/0x70647b5fa9774337 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9774330 expref: 18 pid: 5840 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.193486:0:8498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a542f1000/0x70647b5fa9774337 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa9774330 expref: 18 pid: 5840 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.193498:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a542f1000/0x70647b5fa9774337 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa9774330 expref: 18 pid: 5840 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.193512:0:8498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff931a40030a00/0x70647b5fa977448e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.193522:0:8498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a40030a00/0x70647b5fa977448e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.193539:0:8498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a40030a00/0x70647b5fa977448e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.193547:0:8498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a40030a00/0x70647b5fa977448e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.193555:0:8498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff931a40030a00/0x70647b5fa977448e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.193561:0:8498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff931a40030a00/0x70647b5fa977448e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.193567:0:8498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030a00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:0.0:1787790735.193572:0:8498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff931a40030a00/0x70647b5fa977448e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.193586:0:8498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff931a40030a00/0x70647b5fa977448e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.193601:0:8498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff931a40030a00/0x70647b5fa977448e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.193612:0:8498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790735.193656:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c26b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:3321:x1874634253324160:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790735.193664:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787790735.193695:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253324160:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790735.193719:0:11651:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff931a40030a00/0x70647b5fa977448e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.193775:0:11651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff931a40030a00/0x70647b5fa977448e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790735.193782:0:11651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a40030a00/0x70647b5fa977448e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790735.193951:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790735.193994:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b956aedb-a574-46fa-b700-b912aca9a68a+11:2348:x1874634236514944:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 964us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790735.194002:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:2.0:1787790735.195999:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53f04780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:3318:x1874634253323904:12345-0@lo:103:ldlm_bl.0 Request processed in 4829us (5081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790735.196018:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787790735.197753:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d792940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253323904:0@lo:103:ldlm_bl.0 00000001:00080000:2.0:1787790736.047659:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1787790736.047684:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:2.0:1787790736.047714:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:2.0:1787790736.047988:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787790736.048012:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a813dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253324288:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787790736.048084:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790736.048246:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253324288 00000100:00100000:1.0:1787790736.048253:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253324288 00000100:00080000:3.0:1787790736.048306:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790736.048326:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787790736.048336:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53f04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253324288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787790736.048365:0:8297:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1787790736.048451:0:8297:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8f858a, atime: 0x6a8f858a, ctime: 0x6a8f858a, blocks: 0x1 00010000:00010000:1.0:1787790736.048460:0:8297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9774495 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790736.048477:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=270s v=(0 0) 00010000:00010000:1.0:1787790736.048482:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790736.048489:0:8297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9774495 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790736.048507:0:8297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9774495 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790736.048533:0:8297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9774495 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790736.048541:0:8297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9774495 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790736.048568:0:8297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787790736.048851:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790736.048859:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9774495 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790736.048868:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705600 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:0.0:1787790736.048873:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9774495 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790736.048895:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9774495 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790736.048915:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9774495 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790736.048923:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9774495 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790736.048942:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790736.048944:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790736.048946:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790736.049527:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53f04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1874634253324288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1191us (1440us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787790736.049537:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1787790736.060171:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff931a813dc3c0/2, rc 0, transno 4294967300 00000100:00100000:2.0:1787790736.060197:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a813dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253324288:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787790736.128059:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790736.301517:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790736.301573:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790736.301769:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236515200 00000100:00100000:1.0:1787790736.301781:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236515200 00000100:00100000:1.0:1787790736.301870:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 96 00000100:00100000:1.0:1787790736.301881:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2347:x1874634236515200:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790736.301962:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2347:x1874634236515200:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 83us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790736.301970:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 96 00000100:00100000:0.0:1787790736.302151:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236515072 00000100:00100000:0.0:1787790736.302156:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236515072 00000100:00100000:0.0:1787790736.302270:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 246 00000100:00100000:0.0:1787790736.302278:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+11:2347:x1874634236515072:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790736.302313:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+11:2347:x1874634236515072:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 36us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790736.302319:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 246 00000100:00080000:3.0:1787790736.302644:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790736.305800:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790736.305852:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790736.306077:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236515456 00000100:00100000:0.0:1787790736.306086:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236515456 00000100:00100000:0.0:1787790736.306168:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 97 00000100:00100000:0.0:1787790736.306178:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2346:x1874634236515456:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790736.306267:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2346:x1874634236515456:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 90us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790736.306290:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 97 00000100:00080000:3.0:1787790736.306570:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790736.307165:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236515328 00000100:00100000:1.0:1787790736.307173:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236515328 00000100:00100000:1.0:1787790736.307280:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:1.0:1787790736.307290:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2346:x1874634236515328:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790736.307354:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2346:x1874634236515328:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 66us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790736.307361:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00080000:3.0:1787790736.308066:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790736.622300:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790736.622753:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236515584 00000100:00100000:2.0:1787790736.622776:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236515584 00000100:00100000:2.0:1787790736.622852:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 247 00000100:00100000:2.0:1787790736.622864:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+11:5585:x1874634236515584:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790736.622881:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790736.622902:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a4654e600/0x70647b5fa977449c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea52 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790736.622932:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a4654e600/0x70647b5fa977449c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea52 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790736.622944:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a4654e600/0x70647b5fa977449c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea52 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790736.622953:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654e600, rc 0) 00000100:00100000:2.0:1787790736.623015:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+12:5585:x1874634236515584:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 154us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790736.623022:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 247 00000100:00100000:2.0:1787790736.630651:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790736.630802:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236515712 00000100:00100000:1.0:1787790736.630812:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236515712 00000100:00100000:1.0:1787790736.630870:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 248 00000100:00100000:1.0:1787790736.630880:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+12:5585:x1874634236515712:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790736.631884:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+12:5585:x1874634236515712:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 297us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790736.631900:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 248 00000100:00100000:1.0:1787790736.636770:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790736.636865:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236515840 00000100:00100000:0.0:1787790736.636875:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236515840 00000100:00100000:0.0:1787790736.636986:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 249 00000100:00100000:0.0:1787790736.636998:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+12:5585:x1874634236515840:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790736.637243:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+12:5585:x1874634236515840:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 Request processed in 247us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790736.637253:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 249 00000100:00100000:3.0:1787790736.644651:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790736.644761:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236515968 00000100:00100000:1.0:1787790736.644771:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236515968 00000100:00100000:1.0:1787790736.644817:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 250 00000100:00100000:1.0:1787790736.644828:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+12:9960:x1874634236515968:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787790736.645073:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+12:9960:x1874634236515968:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 246us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790736.645081:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 250 00000100:00100000:3.0:1787790736.652906:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790736.653257:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236516096 00000100:00100000:0.0:1787790736.653267:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236516096 00000100:00100000:0.0:1787790736.653321:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 251 00000100:00100000:0.0:1787790736.653330:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+12:9960:x1874634236516096:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787790736.653631:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+12:9960:x1874634236516096:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 286us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790736.653641:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 251 00000100:00100000:0.0:1787790736.658547:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790736.658663:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236516224 00000100:00100000:2.0:1787790736.658672:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236516224 00000100:00100000:2.0:1787790736.658720:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 252 00000100:00100000:2.0:1787790736.658754:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+12:5585:x1874634236516224:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790736.658771:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790736.658789:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a4654fa00/0x70647b5fa97744a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea59 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790736.658819:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a4654fa00/0x70647b5fa97744a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea59 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790736.658858:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a4654fa00/0x70647b5fa97744a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea59 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790736.658867:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654fa00, rc 0) 00000100:00100000:2.0:1787790736.658926:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+13:5585:x1874634236516224:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 174us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790736.658933:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 252 00000100:00100000:3.0:1787790736.660899:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790736.661131:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236516352 00000100:00100000:1.0:1787790736.661141:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236516352 00000100:00100000:1.0:1787790736.661193:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 253 00000100:00100000:1.0:1787790736.661202:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:5585:x1874634236516352:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790736.661499:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:5585:x1874634236516352:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 297us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790736.661507:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 253 00000100:00100000:3.0:1787790736.667169:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790736.669696:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236516480 00000100:00100000:0.0:1787790736.669711:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236516480 00000100:00100000:0.0:1787790736.671357:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 254 00000100:00100000:0.0:1787790736.671378:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+13:5585:x1874634236516480:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790736.671628:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+13:5585:x1874634236516480:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 Request processed in 250us (4461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790736.671636:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 254 00000100:00100000:2.0:1787790736.677005:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790736.685605:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236516608 00000100:00100000:1.0:1787790736.685630:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236516608 00000100:00100000:1.0:1787790736.685681:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 255 00000100:00100000:1.0:1787790736.685691:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:9963:x1874634236516608:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787790736.685977:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:9963:x1874634236516608:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 286us (8982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790736.685985:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 255 00000100:00100000:3.0:1787790736.702965:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790736.708718:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236516736 00000100:00100000:1.0:1787790736.708746:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236516736 00000100:00100000:1.0:1787790736.708819:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 256 00000100:00100000:1.0:1787790736.708829:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:9963:x1874634236516736:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787790736.709522:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:9963:x1874634236516736:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 690us (6562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790736.709533:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 256 10000000:01000000:0.0:1787790737.025881:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787790737.025911:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9319447e6800 from 7 10000000:01000000:0.0:1787790737.025916:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787790737.025971:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40030e00/0x70647b5fa97744aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790737.025985:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a40030e00/0x70647b5fa97744aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790737.025997:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a40030e00/0x70647b5fa97744aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790737.026027:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c268000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253324416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787790737.026103:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790737.026167:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67d4bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787790737.026849:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253324416 00000100:00100000:2.0:1787790737.026858:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253324416 00000100:00100000:2.0:1787790737.026926:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787790737.026935:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+16:5843:x1874634253324416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790737.026949:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790737.026981:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a4654e800/0x70647b5fa97744b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97744aa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790737.027009:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a4654e800/0x70647b5fa97744b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97744aa expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790737.027021:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a4654e800/0x70647b5fa97744b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97744aa expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790737.027030:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654e800, rc 0) 00000100:00100000:2.0:1787790737.027102:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253324416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790737.027110:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787790737.027173:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c268000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253324416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790737.027195:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a40030e00/0x70647b5fa97744aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97744b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790737.027203:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a40030e00/0x70647b5fa97744aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97744b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790737.027267:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a813df840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253324544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790737.027307:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790737.027342:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a80c16840 going to sleep for 11 seconds 00000100:00100000:1.0:1787790737.027413:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253324544 00000100:00100000:1.0:1787790737.027417:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253324544 00000100:00100000:1.0:1787790737.027451:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787790737.027458:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253324544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790737.028918:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253324544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1451us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790737.028930:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787790737.033825:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a813df840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253324544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790737.034019:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a813df840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253324672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790737.034105:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790737.034286:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a80c16840 going to sleep for 11 seconds 00000100:00100000:0.0:1787790737.034788:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253324672 00000100:00100000:0.0:1787790737.034797:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253324672 00000100:00100000:0.0:1787790737.034956:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787790737.035015:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253324672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790737.037824:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253324672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2850us (3708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790737.038509:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a813df840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253324672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790737.038608:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787790737.039263:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c269680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:11667:1874634253324800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790737.039329:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790737.039371:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67d4b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787790737.039494:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253324800 00000100:00100000:1.0:1787790737.039501:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253324800 00000100:00100000:1.0:1787790737.039548:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787790737.039558:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:11667:x1874634253324800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790737.039824:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:11667:x1874634253324800:12345-0@lo:502:llog_process_th.0 Request processed in 266us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790737.039831:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787790737.040123:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c269680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:11667:1874634253324800:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787790737.040154:0:11667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790737.040166:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790737.040180:0:11667:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787790737.040197:0:11667:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9319447e6800 00000020:00000080:0.0:1787790737.040200:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787790737.040285:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c269680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:11667:1874634253324928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790737.040326:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790737.040362:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a488cb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790737.040490:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253324928 00000100:00100000:3.0:1787790737.040496:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253324928 00000100:00100000:3.0:1787790737.040542:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787790737.040551:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42f01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:11667:x1874634253324928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790737.040753:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42f01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:11667:x1874634253324928:12345-0@lo:502:llog_process_th.0 Request processed in 203us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790737.040760:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787790737.041098:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c269680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:11667:1874634253324928:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787790737.041126:0:11667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790737.041131:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790737.041133:0:11667:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787790737.041137:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787790737.053774:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787790737.053815:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787790737.053827:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40030e00/0x70647b5fa97744aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97744b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790737.053839:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a40030e00/0x70647b5fa97744aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97744b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790737.053849:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787790737.053852:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff931a493ae800 from 7 10000000:01000000:2.0:1787790737.053855:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787790737.053891:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa97744b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790737.053899:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa97744b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790737.053910:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa97744b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790737.053937:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f06580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253325056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787790737.054006:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790737.054047:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a478f19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790737.054140:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253325056 00000100:00100000:3.0:1787790737.054147:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253325056 00000100:00100000:3.0:1787790737.054193:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787790737.054201:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:5843:x1874634253325056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790737.054213:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790737.054225:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a82152600/0x70647b5fa97744bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97744b8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790737.054247:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a82152600/0x70647b5fa97744bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97744b8 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790737.054257:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a82152600/0x70647b5fa97744bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97744b8 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790737.054273:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82152600, rc 0) 00000100:00100000:3.0:1787790737.054312:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253325056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790737.054320:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787790737.057907:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f06580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253325056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790737.057938:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa97744b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97744bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790737.057951:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa97744b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97744bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790737.058027:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f06580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253325184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790737.058091:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790737.058143:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a478f19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790737.058374:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253325184 00000100:00100000:3.0:1787790737.058381:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253325184 00000100:00100000:3.0:1787790737.058432:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787790737.058441:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253325184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790737.058774:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253325184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 332us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790737.058782:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787790737.058999:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f06580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253325184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790737.059036:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f06580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253325312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790737.059079:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790737.059109:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a478f19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790737.060681:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253325312 00000100:00100000:3.0:1787790737.060693:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253325312 00000100:00100000:3.0:1787790737.060777:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787790737.060787:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253325312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790737.061013:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253325312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 227us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790737.061022:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787790737.061337:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f06580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253325312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790737.075857:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:11670:1874634253325440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790737.075944:0:11670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790737.075986:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a478f1900 going to sleep for 11 seconds 00000100:00100000:0.0:1787790737.076066:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253325440 00000100:00100000:0.0:1787790737.076073:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253325440 00000100:00100000:0.0:1787790737.076117:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787790737.076126:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:11670:x1874634253325440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790737.076340:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:11670:x1874634253325440:12345-0@lo:502:llog_process_th.0 Request processed in 214us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790737.076348:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787790737.078213:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:11670:1874634253325440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787790737.078260:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790737.078270:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790737.078272:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787790737.078278:0:11670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff931a493ae800 00000020:00000080:2.0:1787790737.078281:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787790737.078368:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:11670:1874634253325568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790737.078430:0:11670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790737.078463:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253325568 00000100:00100000:2.0:1787790737.078468:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253325568 00000100:00100000:2.0:1787790737.078502:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787790737.078509:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:11670:x1874634253325568:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790737.078719:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:11670:x1874634253325568:12345-0@lo:502:llog_process_th.0 Request processed in 209us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790737.078752:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787790737.078795:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a478f1900 going to sleep for 11 seconds 00000100:00100000:2.0:1787790737.078811:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:11670:1874634253325568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787790737.078827:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790737.078830:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790737.078832:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787790737.078835:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787790737.079131:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787790737.079148:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787790737.079158:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa97744b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97744bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790737.079169:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa97744b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97744bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790737.079179:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787790737.079186:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff931a4977d000 from 7 10000000:01000000:0.0:1787790737.079189:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787790737.079211:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa97744c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790737.079219:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa97744c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790737.079228:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa97744c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790737.079242:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c269680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253325696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787790737.079271:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790737.079292:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67d4b900 going to sleep for 11 seconds 00000100:00100000:2.0:1787790737.079689:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253325696 00000100:00100000:2.0:1787790737.079694:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253325696 00000100:00100000:2.0:1787790737.079744:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787790737.079751:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:5843:x1874634253325696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790737.079761:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790737.079773:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a4654f800/0x70647b5fa97744cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97744c6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790737.079794:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a4654f800/0x70647b5fa97744cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97744c6 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790737.079806:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a4654f800/0x70647b5fa97744cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97744c6 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790737.079815:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654f800, rc 0) 00000100:00100000:2.0:1787790737.079850:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:5843:x1874634253325696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790737.079856:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787790737.079889:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c269680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253325696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790737.079901:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa97744c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97744cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790737.079910:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa97744c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97744cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790737.079958:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253325824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790737.079981:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790737.079992:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a478f1000 going to sleep for 11 seconds 00000100:00100000:2.0:1787790737.080004:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253325824 00000100:00100000:2.0:1787790737.080006:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253325824 00000100:00100000:2.0:1787790737.080023:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787790737.080028:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46532850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:5843:x1874634253325824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790737.080229:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46532850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:5843:x1874634253325824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790737.080235:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787790737.080260:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253325824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790737.080281:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253325952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790737.080312:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790737.080323:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a478f1000 going to sleep for 11 seconds 00000100:00100000:2.0:1787790737.080333:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253325952 00000100:00100000:2.0:1787790737.080335:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253325952 00000100:00100000:2.0:1787790737.080352:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787790737.080356:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46533850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:5843:x1874634253325952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790737.080465:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46533850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:5843:x1874634253325952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790737.080471:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787790737.080500:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:5843:1874634253325952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790737.087012:0:11672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:11672:1874634253326080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790737.087103:0:11672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790737.087148:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253326080 00000100:00100000:2.0:1787790737.087155:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253326080 00000100:00100000:2.0:1787790737.087203:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787790737.087211:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:11672:x1874634253326080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790737.087431:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:11672:x1874634253326080:12345-0@lo:502:llog_process_th.0 Request processed in 220us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790737.087440:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787790737.087493:0:11672:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a478f1840 going to sleep for 11 seconds 00000100:00100000:2.0:1787790737.087514:0:11672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:11672:1874634253326080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787790737.087543:0:11672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790737.087553:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790737.087555:0:11672:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787790737.087575:0:11672:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff931a4977d000 00000020:00000080:2.0:1787790737.087579:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787790737.087924:0:11672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:11672:1874634253326208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790737.087963:0:11672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790737.087987:0:11672:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a478f1840 going to sleep for 11 seconds 00000040:00080000:1.0:1787790737.089298:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787790737.089418:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253326208 00000100:00100000:1.0:1787790737.089426:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253326208 00000100:00100000:1.0:1787790737.089474:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787790737.089482:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:11672:x1874634253326208:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790737.089895:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:11672:x1874634253326208:12345-0@lo:502:llog_process_th.0 Request processed in 412us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790737.089903:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787790737.090410:0:11672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53f070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:11672:1874634253326208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787790737.090449:0:11672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790737.090458:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790737.090461:0:11672:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787790737.090465:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787790737.090805:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787790737.090825:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787790737.090846:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa97744c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97744cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790737.090857:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa97744c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97744cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790737.153041:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787790738.113105:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787790738.176180:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790738.496392:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a813df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253326336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790738.496470:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790738.496637:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253326336 00000100:00100000:3.0:1787790738.496647:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253326336 00000100:00100000:3.0:1787790738.496719:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787790738.496750:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a479283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1874634253326336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790738.496788:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790738.496846:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a479283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1874634253326336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790738.496854:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787790738.497107:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a813df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253326336:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787790738.497339:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787790739.200267:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790739.520117:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c26b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1874634253326720:0@lo:400:kworker.0 00000100:00100000:0.0:1787790739.520194:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790739.520264:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787790739.520271:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c26a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253326592:0@lo:400:kworker.0 00000100:00100000:0.0:1787790739.520296:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790739.520311:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c269680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253327104:0@lo:400:kworker.0 00000100:00100000:0.0:1787790739.520334:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790739.520370:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253326720 00000100:00100000:0.0:1787790739.520377:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253326720 00000100:00100000:0.0:1787790739.520430:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253326592 00000100:00100000:0.0:1787790739.520432:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253326592 00000100:00100000:0.0:1787790739.520453:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787790739.520462:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874634253326720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790739.520546:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874634253326720:12345-0@lo:400:kworker.0 Request processed in 84us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790739.520555:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787790739.520599:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787790739.520606:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d790f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253326592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790739.520635:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d790f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253326592:12345-0@lo:400:kworker.0 Request processed in 30us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790739.520641:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787790739.520680:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c26a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253326592:0@lo:400:kworker.0 00000100:00100000:0.0:1787790739.520692:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c26b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1874634253326720:0@lo:400:kworker.0 00000100:00100000:3.0:1787790739.520847:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253326848:0@lo:400:kworker.0 00000100:00100000:3.0:1787790739.520877:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790739.520923:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787790739.520930:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c26b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253326464:0@lo:400:kworker.0 00000100:00100000:3.0:1787790739.520961:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790739.520994:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c2692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1874634253326976:0@lo:400:kworker.0 00000100:00100000:3.0:1787790739.521017:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790739.521041:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253326976 00000100:00100000:3.0:1787790739.521045:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253326976 00000100:00100000:3.0:1787790739.521073:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787790739.521079:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874634253326976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790739.521113:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874634253326976:12345-0@lo:400:kworker.0 Request processed in 34us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790739.521119:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787790739.521150:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c2692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1874634253326976:0@lo:400:kworker.0 00000100:00100000:0.0:1787790739.521638:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253327104 00000100:00100000:0.0:1787790739.521644:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253327104 00000100:00080000:3.0:1787790739.521884:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787790739.521898:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790739.521914:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253326464 00000100:00100000:3.0:1787790739.521918:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253326464 00000100:00100000:3.0:1787790739.521943:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787790739.521949:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46533450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3318:x1874634253326464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790739.522004:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46533450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3318:x1874634253326464:12345-0@lo:400:kworker.0 Request processed in 55us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790739.522010:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787790739.522035:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790739.522045:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a813de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253327232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790739.522074:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790739.522107:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c26b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253326464:0@lo:400:kworker.0 00000100:00100000:3.0:1787790739.522142:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253327232 00000100:00100000:3.0:1787790739.522145:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253327232 00000100:00100000:3.0:1787790739.522165:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787790739.522171:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1874634253327232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787790739.522200:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790739.522231:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1874634253327232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790739.522237:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787790739.522259:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a813de580 x1874634253327232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790739.522276:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a813de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253327232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790739.522344:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253326848 00000100:00100000:0.0:1787790739.522348:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253326848 00000100:00100000:1.0:1787790739.529254:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787790739.529415:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d790780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253327104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790739.529638:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d790780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253327104:12345-0@lo:400:kworker.0 Request processed in 240us (9302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790739.529647:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787790739.529671:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787790739.529679:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1874634253326848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790739.529741:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1874634253326848:12345-0@lo:400:kworker.0 Request processed in 46us (8845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790739.529748:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787790739.529798:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253326848:0@lo:400:kworker.0 00010000:00080000:3.0:1787790739.534530:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7c269680 x1874634253327104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790739.534552:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c269680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253327104:0@lo:400:kworker.0 00010000:00010000:0.0:1787790740.224496:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787790741.149718:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1787790741.253245:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790741.425130:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790741.425466:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790741.425502:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790741.425565:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790741.425611:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236516992 00000100:00100000:3.0:1787790741.425621:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236516992 00000100:00100000:3.0:1787790741.425679:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236517248 00000100:00100000:3.0:1787790741.425682:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236517248 00000100:00100000:3.0:1787790741.425707:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 101 00000100:00100000:3.0:1787790741.425716:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2347:x1874634236516992:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790741.425820:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2347:x1874634236516992:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 104us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790741.425829:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 101 00000100:00100000:3.0:1787790741.425847:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 102 00000100:00100000:3.0:1787790741.425854:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2347:x1874634236517248:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790741.425879:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2347:x1874634236517248:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 26us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790741.425885:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 102 00000100:00080000:3.0:1787790741.425902:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790741.426619:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236517120 00000100:00100000:1.0:1787790741.426626:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236517120 00000100:00100000:1.0:1787790741.426686:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:1.0:1787790741.426708:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2347:x1874634236517120:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790741.426783:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2347:x1874634236517120:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 78us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790741.426789:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00080000:3.0:1787790741.427051:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790741.427939:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236516864 00000100:00100000:2.0:1787790741.427948:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236516864 00000100:00100000:2.0:1787790741.428010:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 273 00000100:00100000:2.0:1787790741.428133:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46533c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+13:2347:x1874634236516864:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790741.428260:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46533c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+13:2347:x1874634236516864:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 128us (3139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790741.428268:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 273 00010000:00010000:0.0:1787790742.273856:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790743.296303:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790743.616367:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790743.616395:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a813dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253327360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787790743.616468:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790743.616749:0:8510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253327360 00000100:00100000:3.0:1787790743.616758:0:8510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253327360 00000100:00100000:3.0:1787790743.616829:0:8510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787790743.616842:0:8510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d792940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253327360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790743.616887:0:8510:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790743.616964:0:8510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d792940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253327360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790743.616998:0:8510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1787790743.617082:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790743.617110:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1787790743.617115:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff931a813dc3c0, transno 4294967300 00000100:00100000:0.0:1787790743.617137:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a813dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253327360:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787790744.321246:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790744.639948:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790744.640248:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787790744.640270:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a813dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253327616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790744.640340:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790744.640409:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253327616 00000100:00100000:3.0:1787790744.640417:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253327616 00000100:00100000:3.0:1787790744.640500:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787790744.640510:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253327616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787790744.640550:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790744.640600:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253327616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790744.640608:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1787790744.640630:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787790744.640658:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a813dc3c0 x1874634253327616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790744.640677:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a813dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253327616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790744.640831:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787790744.640842:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d7921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253327744:0@lo:400:kworker.0 00000100:00100000:2.0:1787790744.640875:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790744.641084:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253327744 00000100:00100000:3.0:1787790744.641089:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253327744 00000100:00100000:3.0:1787790744.641131:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787790744.641138:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53f070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253327744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790744.641177:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53f070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253327744:12345-0@lo:400:kworker.0 Request processed in 40us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790744.641184:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787790744.641261:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d7921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253327744:0@lo:400:kworker.0 00000100:00100000:1.0:1787790744.641435:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c269680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253327872:0@lo:400:kworker.0 00000100:00100000:1.0:1787790744.641554:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790744.641581:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253327488:0@lo:400:kworker.0 00000100:00100000:1.0:1787790744.641610:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790744.641738:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253327872 00000100:00100000:3.0:1787790744.641743:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253327872 00000100:00100000:3.0:1787790744.641790:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787790744.641813:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4792a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253327872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790744.641853:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4792a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253327872:12345-0@lo:400:kworker.0 Request processed in 41us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790744.641860:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787790744.641887:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c269680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253327872:0@lo:400:kworker.0 00000100:00080000:1.0:1787790744.642062:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790744.642259:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c26b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1874634253328128:0@lo:400:kworker.0 00000100:00100000:0.0:1787790744.642290:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790744.642365:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790744.642378:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253328000:0@lo:400:kworker.0 00000100:00100000:3.0:1787790744.642407:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790744.642437:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253328128 00000100:00100000:3.0:1787790744.642441:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253328128 00000100:00100000:3.0:1787790744.642497:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787790744.642504:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c2692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874634253328128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790744.642541:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c2692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874634253328128:12345-0@lo:400:kworker.0 Request processed in 37us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790744.642547:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1787790744.642563:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790744.642715:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253328000 00000100:00100000:0.0:1787790744.642719:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253328000 00000100:00100000:0.0:1787790744.642764:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787790744.642770:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253328000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790744.642810:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253328000:12345-0@lo:400:kworker.0 Request processed in 40us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790744.642816:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787790744.642842:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c26b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1874634253328128:0@lo:400:kworker.0 00000100:00100000:1.0:1787790744.642905:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253328000:0@lo:400:kworker.0 00000100:00100000:2.0:1787790744.642989:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253327488 00000100:00100000:2.0:1787790744.642994:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253327488 00000100:00100000:2.0:1787790744.643129:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787790744.643139:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46531450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3318:x1874634253327488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790744.643185:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46531450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3318:x1874634253327488:12345-0@lo:400:kworker.0 Request processed in 47us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790744.643191:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787790744.643252:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253327488:0@lo:400:kworker.0 00010000:00010000:0.0:1787790745.343950:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790746.367989:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790746.547485:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790746.547577:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790746.547640:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790746.547685:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790746.547776:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236517632 00000100:00100000:1.0:1787790746.547787:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236517632 00000100:00100000:1.0:1787790746.547856:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:1.0:1787790746.547866:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c26b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2347:x1874634236517632:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790746.547949:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c26b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2347:x1874634236517632:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 84us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790746.547956:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:1.0:1787790746.547980:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236517504 00000100:00100000:1.0:1787790746.547984:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236517504 00000100:00100000:1.0:1787790746.548010:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236517760 00000100:00100000:1.0:1787790746.548012:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236517760 00000100:00100000:1.0:1787790746.548035:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 106 00000100:00100000:1.0:1787790746.548041:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c26a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2347:x1874634236517504:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790746.548086:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c26a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2347:x1874634236517504:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 45us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790746.548092:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 106 00000100:00100000:1.0:1787790746.548104:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 107 00000100:00100000:1.0:1787790746.548111:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c26b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2347:x1874634236517760:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790746.548133:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c26b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2347:x1874634236517760:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 23us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790746.548139:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 107 00000100:00080000:0.0:1787790746.548531:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787790746.548537:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790746.549344:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236517376 00000100:00100000:3.0:1787790746.549350:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236517376 00000100:00100000:3.0:1787790746.549387:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 275 00000100:00100000:3.0:1787790746.549392:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46530c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+13:2347:x1874634236517376:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790746.549434:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46530c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+13:2347:x1874634236517376:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 42us (1963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790746.549441:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 275 00010000:00010000:2.0:1787790747.396030:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787790748.352803:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787790748.416930:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790748.735974:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a813dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253328256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787790748.736065:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790748.736094:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253328256 00000100:00100000:1.0:1787790748.736114:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253328256 00000100:00100000:1.0:1787790748.736176:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787790748.736186:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c268f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253328256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787790748.736231:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787790748.736233:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790748.740523:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c268f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253328256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4327us (4446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790748.740537:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787790748.744983:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a813dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253328256:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787790749.440072:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790749.760612:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787790749.760636:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4792bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253328384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790749.760706:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790749.760977:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7c269680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253328512:0@lo:400:kworker.0 00000100:00100000:0.0:1787790749.761014:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790749.761043:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253329024:0@lo:400:kworker.0 00000100:00100000:0.0:1787790749.761071:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790749.761088:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790749.761094:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253328896:0@lo:400:kworker.0 00000100:00100000:0.0:1787790749.761118:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790749.761145:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253328896 00000100:00100000:0.0:1787790749.761152:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253328896 00000100:00100000:0.0:1787790749.761196:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787790749.761204:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253328896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790749.761257:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253328896:12345-0@lo:400:kworker.0 Request processed in 54us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790749.761264:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787790749.761303:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253328896:0@lo:400:kworker.0 00000100:00100000:0.0:1787790749.761327:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1874634253328768:0@lo:400:kworker.0 00000100:00100000:0.0:1787790749.761349:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790749.761367:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787790749.761372:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253328640:0@lo:400:kworker.0 00000100:00100000:0.0:1787790749.761406:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790749.761557:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253329024 00000100:00100000:1.0:1787790749.761562:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253329024 00000100:00100000:1.0:1787790749.761604:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253328768 00000100:00100000:1.0:1787790749.761607:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253328768 00000100:00100000:1.0:1787790749.761621:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253328640 00000100:00100000:1.0:1787790749.761623:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253328640 00000100:00100000:1.0:1787790749.761646:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787790749.761652:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253329024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790749.761692:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253329024:12345-0@lo:400:kworker.0 Request processed in 40us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790749.761699:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787790749.761711:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787790749.761718:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874634253328768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790749.761769:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874634253328768:12345-0@lo:400:kworker.0 Request processed in 52us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790749.761776:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787790749.761787:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787790749.761792:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253328640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790749.761818:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253328640:12345-0@lo:400:kworker.0 Request processed in 26us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790749.761824:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787790749.761863:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253329024:0@lo:400:kworker.0 00000100:00080000:0.0:1787790749.761989:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790749.762011:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253328640:0@lo:400:kworker.0 00000100:00100000:0.0:1787790749.762022:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1874634253328768:0@lo:400:kworker.0 00000100:00100000:3.0:1787790749.762298:0:8510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253328384 00000100:00100000:3.0:1787790749.762303:0:8510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253328384 00000100:00100000:3.0:1787790749.762347:0:8510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787790749.762355:0:8510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a47928f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253328384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787790749.762383:0:8510:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790749.762437:0:8510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a47928f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253328384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (1730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790749.762444:0:8510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1787790749.762474:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787790749.762496:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a4792bc00 x1874634253328384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790749.762511:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4792bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253328384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790749.765537:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253328512 00000100:00100000:3.0:1787790749.765546:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253328512 00000100:00100000:3.0:1787790749.765594:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787790749.765600:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46531850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253328512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790749.765675:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46531850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253328512:12345-0@lo:400:kworker.0 Request processed in 76us (4661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790749.765680:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787790749.766200:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7c269680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253328512:0@lo:400:kworker.0 00010000:00010000:0.0:1787790750.467544:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790751.488178:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790751.668523:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790751.668584:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790751.668608:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790751.668650:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790751.668701:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236518144 00000100:00100000:0.0:1787790751.668709:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236518016 00000100:00100000:0.0:1787790751.668715:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236518016 00000100:00100000:3.0:1787790751.668716:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236518144 00000100:00100000:0.0:1787790751.668822:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236518272 00000100:00100000:0.0:1787790751.668826:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236518272 00000100:00100000:3.0:1787790751.668838:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:3.0:1787790751.668854:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2345:x1874634236518144:12345-192.168.201.25@tcp:9:kworker.0 00000100:00100000:0.0:1787790751.668857:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 111 00000100:00100000:0.0:1787790751.668872:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2349:x1874634236518016:12345-192.168.201.25@tcp:400:kworker.0 00000020:00000080:3.0:1787790751.668898:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa9774409 00000100:00080000:3.0:1787790751.668910:0:6683:0:(import.c:65:import_set_state_nolock()) ffff931a5fca5800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787790751.668970:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1787790751.669047:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 112 00000100:00100000:1.0:1787790751.669058:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2348:x1874634236518272:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790751.669141:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236517888 00000100:00100000:2.0:1787790751.669146:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236517888 00000100:00100000:2.0:1787790751.669184:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 277 00000100:00100000:2.0:1787790751.669192:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a46530850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+13:2349:x1874634236517888:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790751.669875:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2349:x1874634236518016:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 1003us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790751.669885:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 111 00000100:00100000:1.0:1787790751.675039:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2348:x1874634236518272:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 5402us (5806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790751.675062:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 112 00000100:00080000:1.0:1787790751.675164:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787790751.675173:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787790751.675428:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790751.675597:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a46530850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+13:2349:x1874634236517888:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 6401us (7085us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790751.675609:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 277 00000100:00100000:3.0:1787790751.675636:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+2:2345:x1874634236518144:12345-192.168.201.25@tcp:9:kworker.0 Request processed in 6772us (7012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790751.675672:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 19 00010000:00010000:2.0:1787790752.512628:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790753.536018:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790753.856056:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a813df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253329152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787790753.856152:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790753.856294:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253329152 00000100:00100000:1.0:1787790753.856302:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253329152 00000100:00080000:2.0:1787790753.856358:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790753.856386:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787790753.856396:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253329152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787790753.856444:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787790753.859965:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253329152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3560us (3802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790753.859980:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787790753.864478:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a813df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253329152:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787790754.561918:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790754.880398:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790754.880425:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4792b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253329280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790754.880502:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790754.881001:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253329280 00000100:00100000:1.0:1787790754.881010:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253329280 00000100:00100000:1.0:1787790754.881086:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787790754.881096:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253329280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787790754.881138:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787790754.881193:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253329280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790754.881201:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1787790754.881318:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787790754.882290:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a4792b480 x1874634253329280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790754.882324:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4792b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253329280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790754.882668:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a465a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253329792:0@lo:400:kworker.0 00000100:00100000:2.0:1787790754.882779:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a813dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874634253329536:0@lo:400:kworker.0 00000100:00100000:1.0:1787790754.882848:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a813df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253329408:0@lo:400:kworker.0 00000100:00100000:0.0:1787790754.883093:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a465a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253329664:0@lo:400:kworker.0 00000100:00100000:2.0:1787790754.886713:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790754.887084:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253329536 00000100:00100000:2.0:1787790754.887093:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253329536 00000100:00100000:2.0:1787790754.887159:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787790754.887170:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53f05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874634253329536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790754.887230:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53f05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874634253329536:12345-0@lo:400:kworker.0 Request processed in 62us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790754.887237:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787790754.887285:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a813dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874634253329536:0@lo:400:kworker.0 00000100:00100000:1.0:1787790754.887475:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790754.887520:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a465a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1874634253329920:0@lo:400:kworker.0 00000100:00100000:1.0:1787790754.887545:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790754.887620:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253329920 00000100:00100000:1.0:1787790754.887624:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253329920 00000100:00100000:1.0:1787790754.887669:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787790754.887676:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4792b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874634253329920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790754.887719:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4792b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874634253329920:12345-0@lo:400:kworker.0 Request processed in 44us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790754.887768:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787790754.887799:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a465a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1874634253329920:0@lo:400:kworker.0 00000100:00100000:2.0:1787790754.888312:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253329408 00000100:00100000:2.0:1787790754.888317:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253329408 00000100:00100000:2.0:1787790754.888357:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787790754.888364:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45663450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3318:x1874634253329408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790754.888426:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45663450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3318:x1874634253329408:12345-0@lo:400:kworker.0 Request processed in 63us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790754.888432:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:2.0:1787790754.888457:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790754.888476:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a813df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253329408:0@lo:400:kworker.0 00000100:00100000:3.0:1787790754.888798:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790754.889015:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790754.889131:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253329664 00000100:00100000:2.0:1787790754.889136:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253329664 00000100:00100000:2.0:1787790754.889195:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787790754.889203:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253329664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790754.889250:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253329664:12345-0@lo:400:kworker.0 Request processed in 48us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790754.889256:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1787790754.889382:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790754.889505:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a465a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253329664:0@lo:400:kworker.0 00000100:00100000:1.0:1787790754.889561:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253329792 00000100:00100000:1.0:1787790754.889566:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253329792 00000100:00100000:1.0:1787790754.889644:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787790754.889662:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253329792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790754.892365:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253329792:12345-0@lo:400:kworker.0 Request processed in 2705us (3558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790754.892380:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787790754.892696:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a465a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253329792:0@lo:400:kworker.0 00010000:00010000:2.0:1787790755.584388:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787790756.472171:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3e6e059d-f39a-42a8-9e93-fd30a950cc49 00000020:00000080:1.0:1787790756.472179:0:6709:0:(genops.c:885:class_export_put()) final put ffff931a5fca4800/3e6e059d-f39a-42a8-9e93-fd30a950cc49 00000020:00000080:2.0:1787790756.473004:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff931a5fca4800/3e6e059d-f39a-42a8-9e93-fd30a950cc49 for lustre-OST0000 00000020:00000080:2.0:1787790756.473063:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff931a5fca5800 for lustre-OST0000 00010000:00010000:2.0:1787790756.609422:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790756.782072:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790756.782105:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790756.782187:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236518400 00000100:00100000:0.0:1787790756.782196:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236518400 00000100:00100000:0.0:1787790756.782247:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 279 00000100:00100000:0.0:1787790756.782256:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+13:2347:x1874634236518400:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790756.782344:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+13:2347:x1874634236518400:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 89us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790756.782352:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 279 00000100:00100000:1.0:1787790756.782788:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790756.786355:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236518656 00000100:00100000:3.0:1787790756.786378:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236518656 00000100:00100000:3.0:1787790756.786450:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236518528 00000100:00100000:3.0:1787790756.786454:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236518528 00000100:00100000:3.0:1787790756.786484:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 116 00000100:00100000:3.0:1787790756.786494:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a47928780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2347:x1874634236518656:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790756.786572:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a47928780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2347:x1874634236518656:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 80us (4466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790756.786581:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 116 00000100:00100000:3.0:1787790756.786598:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 117 00000100:00100000:3.0:1787790756.786604:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a47928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2347:x1874634236518528:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790756.786627:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a47928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2347:x1874634236518528:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 24us (3841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790756.786633:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 117 00000100:00080000:1.0:1787790756.787017:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787790757.632532:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787790758.335210:0:11835:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 20:32:37 (1787790757) 00000040:00080000:1.0:1787790758.592557:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787790758.659353:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790758.977164:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a465a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253330048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787790758.977254:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790758.977554:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253330048 00000100:00100000:3.0:1787790758.977563:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253330048 00000100:00100000:3.0:1787790758.977667:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787790758.977678:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253330048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790758.977713:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790758.977786:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253330048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790758.977809:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787790758.978780:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a465a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253330048:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787790758.985745:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790759.630491:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790759.630682:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236518784 00000100:00100000:3.0:1787790759.630705:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236518784 00000100:00100000:3.0:1787790759.631176:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:3.0:1787790759.631190:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:10231:x1874634236518784:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787790759.631235:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790759.631377:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa97744d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea60 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787790759.631407:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787790759.631462:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa97744db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790759.631477:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa97744db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790759.631491:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa97744db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790759.632215:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787790759.632232:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787790759.632350:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa97744db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790759.632382:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa97744d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea60 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790759.632400:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa97744db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea60 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790759.632421:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a541ad500) 00010000:00010000:3.0:1787790759.632423:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787790759.632427:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82152800, rc 0) 00000100:00100000:3.0:1787790759.632499:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:10231:x1874634236518784:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 1313us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790759.632508:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:3.0:1787790759.642252:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790759.647398:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236518912 00000100:00100000:0.0:1787790759.647420:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236518912 00000100:00100000:0.0:1787790759.647527:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:0.0:1787790759.647539:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:10232:x1874634236518912:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787790759.647568:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790759.647597:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97744e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea67 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.647681:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa97744e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.647713:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa97744e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.647766:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa97744e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.647936:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa97744f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.647947:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa97744f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.647955:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa97744f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.648609:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478e00/0x70647b5fa97744f7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.648622:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478e00/0x70647b5fa97744f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.648632:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478e00/0x70647b5fa97744f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790759.649208:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787790759.649215:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787790759.649331:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478e00/0x70647b5fa97744f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.649347:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa97744e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.649355:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa97744e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.649362:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa97744e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.649370:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790759.649375:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa97744e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.649385:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa97744e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.649404:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a541ad500) 00010000:00010000:0.0:1787790759.649415:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790759.649422:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa97744e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.649429:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa97744e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.649446:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa97744f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.649452:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa97744f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.649458:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa97744f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.649464:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790759.649468:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa97744f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.649474:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa97744f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.649482:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff931a49c31300) 00010000:00010000:0.0:1787790759.649485:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790759.649487:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa97744f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.649493:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa97744f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.649537:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97744e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea67 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.649566:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478e00/0x70647b5fa97744f7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea67 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790759.649574:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff931a49c31100) 00010000:00010000:0.0:1787790759.649577:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787790759.649579:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41478e00, rc 0) 00000100:00100000:0.0:1787790759.649703:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:10232:x1874634236518912:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 2164us (7462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790759.649713:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:1.0:1787790759.656021:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790759.656262:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236519168 00000100:00100000:2.0:1787790759.656275:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236519168 00000100:00100000:2.0:1787790759.656348:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 34 00000100:00100000:2.0:1787790759.656358:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a47928b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:10232:x1874634236519168:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787790759.656389:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790759.656420:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa97744fe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea6e expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.656510:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774505 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.656526:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774505 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.656559:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774505 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.664511:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977450c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.664537:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977450c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.664551:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977450c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.665175:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e400/0x70647b5fa9774513 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.665187:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e400/0x70647b5fa9774513 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.665194:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e400/0x70647b5fa9774513 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790759.665206:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787790759.666157:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774505 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.666169:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774505 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.666176:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774505 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.666182:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790759.666195:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774505 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.666203:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774505 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.666290:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff931a49c31100) 00010000:00010000:2.0:1787790759.666294:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790759.666298:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774505 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.666305:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774505 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.666318:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977450c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.666324:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977450c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.666330:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977450c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.666335:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790759.666338:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977450c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.666345:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977450c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.666353:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff931a4b7e7600) 00010000:00010000:2.0:1787790759.666356:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790759.666366:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977450c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.666372:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977450c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.672678:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa97744fe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea6e expref: 10 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.672706:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e400/0x70647b5fa9774513 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea6e expref: 9 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790759.672716:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff931a4b7e7200) 00010000:00010000:2.0:1787790759.672718:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790759.672744:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654e400, rc 0) 00000100:00100000:2.0:1787790759.672817:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a47928b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:10232:x1874634236519168:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 16459us (16811us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787790759.672826:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 34 00000100:00100000:1.0:1787790759.676973:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790759.678232:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236519296 00000100:00100000:2.0:1787790759.678250:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236519296 00000100:00100000:2.0:1787790759.678330:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:2.0:1787790759.678340:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4792a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:10232:x1874634236519296:12345-192.168.201.25@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787790759.678457:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4792a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:10232:x1874634236519296:12345-192.168.201.25@tcp:59:lhsmtool_posix.0 Request processed in 119us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790759.678465:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 35 00010000:00010000:2.0:1787790759.679931:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790760.003170:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787790760.003198:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a479292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253330176:0@lo:400:kworker.0 00000100:00100000:1.0:1787790760.003314:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790760.004955:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a465a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1874634253330688:0@lo:400:kworker.0 00000100:00100000:3.0:1787790760.005016:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790760.005070:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787790760.005077:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a465a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253330304:0@lo:400:kworker.0 00000100:00100000:3.0:1787790760.005100:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790760.005131:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a465a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253330816:0@lo:400:kworker.0 00000100:00100000:3.0:1787790760.005156:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790760.005185:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a465a3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253330432:0@lo:400:kworker.0 00000100:00100000:3.0:1787790760.005208:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790760.005240:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790760.005245:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a465a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253330560:0@lo:400:kworker.0 00000100:00100000:3.0:1787790760.005269:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790760.005302:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253330688 00000100:00100000:3.0:1787790760.005309:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253330688 00000100:00100000:3.0:1787790760.005359:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253330304 00000100:00100000:3.0:1787790760.005362:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253330304 00000100:00100000:3.0:1787790760.005380:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253330432 00000100:00100000:3.0:1787790760.005383:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253330432 00000100:00100000:3.0:1787790760.005417:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787790760.005425:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874634253330688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790760.005477:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253330176 00000100:00100000:3.0:1787790760.005479:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874634253330688:12345-0@lo:400:kworker.0 Request processed in 55us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790760.005482:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253330176 00000100:00100000:3.0:1787790760.005486:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787790760.005503:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787790760.005509:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253330304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790760.005536:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787790760.005537:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253330304:12345-0@lo:400:kworker.0 Request processed in 29us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790760.005542:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787790760.005543:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45661450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3321:x1874634253330176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790760.005553:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787790760.005558:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253330432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790760.005653:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45661450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3321:x1874634253330176:12345-0@lo:400:kworker.0 Request processed in 110us (2339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790760.005660:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787790760.005662:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253330432:12345-0@lo:400:kworker.0 Request processed in 105us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790760.005668:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787790760.005688:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253330816 00000100:00100000:3.0:1787790760.005692:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253330816 00000100:00100000:3.0:1787790760.005715:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253330560 00000100:00100000:3.0:1787790760.005718:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253330560 00000100:00100000:1.0:1787790760.005746:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787790760.005753:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253330816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790760.005759:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787790760.005764:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253330560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790760.005784:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253330816:12345-0@lo:400:kworker.0 Request processed in 31us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790760.005788:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253330560:12345-0@lo:400:kworker.0 Request processed in 24us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790760.005790:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787790760.005794:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1787790760.005997:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787790760.006000:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787790760.006002:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790760.006300:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a465a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253330304:0@lo:400:kworker.0 00010000:00080000:3.0:1787790760.006316:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a465a2580 x1874634253330816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790760.006324:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a465a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253330816:0@lo:400:kworker.0 00000100:00100000:3.0:1787790760.006334:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a465a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1874634253330688:0@lo:400:kworker.0 00000100:00100000:3.0:1787790760.006372:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a465a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253330560:0@lo:400:kworker.0 00000100:00100000:3.0:1787790760.006379:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a465a3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253330432:0@lo:400:kworker.0 00000100:00100000:3.0:1787790760.006428:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a479292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253330176:0@lo:400:kworker.0 00000100:00100000:3.0:1787790760.006936:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a465a3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253330944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790760.006984:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790760.007364:0:8510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253330944 00000100:00100000:3.0:1787790760.007372:0:8510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253330944 00000100:00100000:3.0:1787790760.007432:0:8510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787790760.007442:0:8510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253330944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787790760.007476:0:8510:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790760.007527:0:8510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253330944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790760.007534:0:8510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1787790760.007576:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a465a3840 x1874634253330944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790776 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790760.007591:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a465a3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253330944:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787790760.641338:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787790760.706364:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790761.510483:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790761.511309:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236519424 00000100:00100000:0.0:1787790761.511322:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236519424 00000100:00100000:0.0:1787790761.511386:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:0.0:1787790761.511395:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:10274:x1874634236519424:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1787790761.511415:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790761.511434:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774521 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea75 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.511503:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774528 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.511517:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774528 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.511529:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774528 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.511553:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977452f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.511560:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977452f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.511566:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977452f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.511998:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774528 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.512005:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774528 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.512011:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774528 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.512016:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41478800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790761.512020:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774528 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.512027:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774528 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.512038:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a541ad500) 00010000:00010000:0.0:1787790761.512041:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790761.512046:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774528 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.512052:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774528 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.512072:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977452f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.512078:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977452f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.512084:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977452f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.512264:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790761.512267:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977452f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.512274:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977452f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.512283:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff931a49c31e00) 00010000:00010000:0.0:1787790761.512285:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790761.512288:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977452f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.512294:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977452f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.512327:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774521 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea75 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.512338:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a541ad500) 00010000:00010000:0.0:1787790761.512341:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790761.512351:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774521 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea75 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.512361:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41479200, rc 0) 00000100:00100000:0.0:1787790761.512429:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:10274:x1874634236519424:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1035us (1955us total) trans 0 rc 301/301 00000100:00100000:0.0:1787790761.512437:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00080000:0.0:1787790761.512655:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790761.532257:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790761.532295:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236519680 00000100:00100000:1.0:1787790761.532304:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236519680 00000100:00100000:1.0:1787790761.532352:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00100000:1.0:1787790761.532362:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4792bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:10274:x1874634236519680:12345-192.168.201.25@tcp:36:lfs.0 00010000:00010000:1.0:1787790761.532416:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790761.532441:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa97744db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea60 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.535204:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a541ad500) 00010000:00010000:1.0:1787790761.535222:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790761.535471:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa9774536 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.535487:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa9774536 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.535498:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa9774536 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.535517:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa977453d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.535523:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa977453d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.535529:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa977453d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790761.538252:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787790761.538268:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa9774536 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.538279:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa9774536 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.538287:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa9774536 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.538293:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790761.538297:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa9774536 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.538304:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa9774536 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.538320:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a488be000) 00010000:00010000:1.0:1787790761.538323:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790761.538327:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa9774536 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.538342:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa9774536 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790761.538361:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4699e11 reply state 00000000deccea3b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa977453d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790761.538369:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787790761.540642:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4792bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+10:10274:x1874634236519680:12345-192.168.201.25@tcp:36:lfs.0 Request processed in 8271us (8380us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787790761.540655:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 37 00010000:00010000:3.0:1787790761.556854:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa977453d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790761.556869:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa977453d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790761.556876:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa977453d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790761.556882:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790761.556888:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa977453d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790761.556896:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa977453d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790761.556912:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff931a488be600) 00010000:00010000:3.0:1787790761.556915:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790761.556919:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa977453d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790761.556925:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa977453d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787790761.606370:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:1.0:1787790761.636894:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790761.637009:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236519808 00000100:00100000:0.0:1787790761.637020:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236519808 00000100:00100000:0.0:1787790761.637078:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:0.0:1787790761.637088:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4792b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:10282:x1874634236519808:12345-192.168.201.25@tcp:101:lctl.0 00010000:00010000:0.0:1787790761.637112:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790761.637135:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774544 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea7c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.637211:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977454b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.637227:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977454b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.637239:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977454b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790761.637437:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787790761.637441:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787790761.637549:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977454b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.637585:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774544 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea7c expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.637604:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977454b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea7c expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.637612:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a49c31300) 00010000:00010000:0.0:1787790761.637615:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787790761.637618:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41479e00, rc 0) 00000100:00100000:0.0:1787790761.637684:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4792b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:10282:x1874634236519808:12345-192.168.201.25@tcp:101:lctl.0 Request processed in 598us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790761.637692:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:3.0:1787790761.713701:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790761.714059:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236519936 00000100:00100000:1.0:1787790761.714070:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236519936 00000100:00100000:1.0:1787790761.714139:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:1.0:1787790761.714149:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:10288:x1874634236519936:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1787790761.714168:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790761.714216:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774552 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea83 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.714282:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774559 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.714298:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774559 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.714310:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774559 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.714325:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774560 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.714346:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.714354:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.714809:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa9774567 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.714819:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa9774567 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.714826:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa9774567 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790761.714926:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787790761.714930:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787790761.715029:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa9774567 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.715043:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774559 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.715050:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774559 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.715057:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774559 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.715063:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790761.715067:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774559 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.715080:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774559 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.715092:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a49c31300) 00010000:00010000:1.0:1787790761.715095:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790761.715100:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774559 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.715106:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774559 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.715119:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.715125:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774560 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.715131:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774560 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.715136:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790761.715138:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774560 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.715144:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774560 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.715151:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff931a488be800) 00010000:00010000:1.0:1787790761.715153:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790761.715156:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774560 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.715171:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774560 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.715218:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774552 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea83 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.715232:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa9774567 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea83 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.715240:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:1.0:1787790761.715242:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787790761.715244:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45704a00, rc 0) 00000100:00100000:1.0:1787790761.715319:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:10288:x1874634236519936:12345-192.168.201.25@tcp:101:bash.0 Request processed in 1171us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790761.715327:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:1.0:1787790761.719846:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790761.719925:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236520192 00000100:00100000:0.0:1787790761.719935:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236520192 00000100:00100000:0.0:1787790761.719998:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:0.0:1787790761.720009:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a479292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:10288:x1874634236520192:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:0.0:1787790761.720028:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790761.720046:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa977456e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea8a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.720392:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774575 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.720408:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774575 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.720418:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774575 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.720494:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa977457c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.720502:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa977457c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.720510:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa977457c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787790761.721311:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787790761.721578:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774583 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.721590:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.721598:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.721630:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774575 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.721638:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774575 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.721645:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774575 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.721650:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41478800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790761.721655:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774575 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.721672:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774575 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.721686:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:0.0:1787790761.721689:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790761.721694:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774575 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.721700:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774575 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790761.721714:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050d7f5e3 reply state 00000000228a6da8 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa977457c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790761.721748:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787790761.721780:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa977456e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea8a expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.721795:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774583 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea8a expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.721802:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a49c31000) 00010000:00010000:0.0:1787790761.721803:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790761.721806:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a40031400, rc 0) 00000100:00100000:0.0:1787790761.721883:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a479292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+12:10288:x1874634236520192:12345-192.168.201.25@tcp:101:bash.0 Request processed in 1875us (2046us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787790761.721892:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 40 00010000:00010000:1.0:1787790761.728539:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa977457c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.728557:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa977457c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.728565:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa977457c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.728570:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790761.728575:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa977457c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.728601:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa977457c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.728618:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff931a49c31e00) 00010000:00010000:1.0:1787790761.728620:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790761.728625:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa977457c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.728631:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa977457c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790761.729056:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790761.731987:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790761.732072:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236520320 00000100:00100000:3.0:1787790761.732080:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236520320 00000100:00100000:0.0:1787790761.732215:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:0.0:1787790761.732226:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c269680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1874634236520320:12345-192.168.201.25@tcp:8:bash.0 00010000:00080000:0.0:1787790761.732287:0:6685:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp t0 exp 0000000000000000 cur 296 last 0 00000020:00000080:0.0:1787790761.732321:0:6685:0:(genops.c:1385:class_connect()) connect: client 3e6e059d-f39a-42a8-9e93-fd30a950cc49, cookie 0x70647b5fa9774591 00002000:00100000:0.0:1787790761.732334:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3e6e059d-f39a-42a8-9e93-fd30a950cc49/ffff931a49c0d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787790761.732357:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787790761.732602:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787790761.732634:0:6685:0:(import.c:65:import_set_state_nolock()) ffff931a49c0e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787790761.732719:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c269680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2345:x1874634236520320:12345-192.168.201.25@tcp:8:bash.0 Request processed in 492us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790761.732773:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:1.0:1787790761.738843:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790761.738941:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236520448 00000100:00100000:3.0:1787790761.738950:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236520448 00000100:00100000:3.0:1787790761.739155:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:3.0:1787790761.739168:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:0:x1874634236520448:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1787790761.739211:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790761.739235:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfc086e4/0x70647b5fa9774598 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea91 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787790761.739261:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787790761.739280:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=296s v=(0 0) 00010000:00010000:3.0:1787790761.739285:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790761.739294:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfc086e4/0x70647b5fa9774598 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea91 expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790761.739315:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dfc086e4/0x70647b5fa9774598 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea91 expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790761.739328:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153200, rc 0) 00000100:00100000:3.0:1787790761.739384:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:0:x1874634236520448:12345-192.168.201.25@tcp:101:bash.0 Request processed in 219us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790761.739392:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00080000:1.0:1787790761.740343:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790761.746081:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790761.746269:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236520576 00000100:00100000:2.0:1787790761.746294:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236520576 00000100:00100000:2.0:1787790761.746357:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:2.0:1787790761.746368:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:10288:x1874634236520576:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:2.0:1787790761.746387:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790761.746407:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977459f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea98 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790761.746437:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfc086e4/0x70647b5fa9774598 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea91 expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790761.746446:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790761.746450:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790761.746456:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977459f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea98 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790761.746490:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dfc086e4/0x70647b5fa9774598 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea91 expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790761.746505:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dfc086e4/0x70647b5fa9774598 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea91 expref: 8 pid: 6683 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790761.746519:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d793480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1874634253331072:192.168.201.25@tcp:104: 00000100:00100000:2.0:1787790761.746608:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47c65d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787790761.751524:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790761.752192:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236520704 00000100:00100000:0.0:1787790761.752201:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236520704 00010000:00010000:0.0:1787790761.752240:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dfc086e4/0x70647b5fa9774598 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea91 expref: 9 pid: 6683 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790761.752285:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:0.0:1787790761.752294:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:2348:x1874634236520704:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790761.752309:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790761.752330:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dfc086e4/0x70647b5fa9774598 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea91 expref: 9 pid: 6683 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.752345:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dfc086e4/0x70647b5fa9774598 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea91 expref: 9 pid: 6683 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.752372:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790761.752377:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790761.752399:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977459f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea98 expref: 9 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.752411:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977459f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea98 expref: 9 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790761.752447:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977459f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea98 expref: 9 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790761.752466:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db45a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1874634253331200:192.168.201.25@tcp:105: 00000100:00100000:0.0:1787790761.752551:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a48c0b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787790761.755443:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db45a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1874634253331200:192.168.201.25@tcp:105: 00010000:00010000:0.0:1787790761.755469:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790761.755534:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:2348:x1874634236520704:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 3240us (4022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790761.755544:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 35 00010000:00010000:2.0:1787790761.756370:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfc086e4/0x70647b5fa9774598 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea91 expref: 8 pid: 6683 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790761.756411:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d793480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1874634253331072:192.168.201.25@tcp:104: 00010000:00010000:2.0:1787790761.756435:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977459f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea98 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790761.756450:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654ec00, rc 0) 00000100:00100000:2.0:1787790761.756498:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:10288:x1874634236520576:12345-192.168.201.25@tcp:101:bash.0 Request processed in 10132us (10427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790761.756506:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:3.0:1787790761.760339:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790761.760550:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236520960 00000100:00100000:2.0:1787790761.760560:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236520960 00000100:00100000:2.0:1787790761.760718:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:2.0:1787790761.760775:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+11:10288:x1874634236520960:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:2.0:1787790761.761484:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+12:10288:x1874634236520960:12345-192.168.201.25@tcp:35:bash.0 Request processed in 710us (1154us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787790761.761494:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:1.0:1787790761.898306:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790761.898466:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236521216 00000100:00100000:3.0:1787790761.898478:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236521216 00000100:00100000:3.0:1787790761.898542:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 41 00000100:00100000:3.0:1787790761.898553:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+12:10298:x1874634236521216:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1787790761.898578:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790761.898600:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa97745a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ea9f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790761.898984:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787790761.899118:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa97745a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea9f expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790761.899132:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a49c31300) 00010000:00010000:3.0:1787790761.899135:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787790761.899140:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa97745a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea9f expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790761.899153:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153400, rc 0) 00000100:00100000:3.0:1787790761.899229:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+13:10298:x1874634236521216:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 677us (932us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1787790761.899236:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 41 00000100:00100000:3.0:1787790761.906227:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790761.906557:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236521472 00000100:00100000:1.0:1787790761.906568:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236521472 00000100:00100000:1.0:1787790761.906654:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:1.0:1787790761.906665:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+13:10298:x1874634236521472:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:1.0:1787790761.907480:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+14:10298:x1874634236521472:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 811us (1257us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787790761.907491:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:2.0:1787790761.910393:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790761.910565:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790761.911466:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236521728 00000100:00100000:3.0:1787790761.911477:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236521728 00000100:00100000:2.0:1787790761.911620:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 121 00000100:00100000:2.0:1787790761.911630:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2346:x1874634236521728:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790761.912000:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2346:x1874634236521728:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 370us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790761.912008:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 121 00000100:00080000:3.0:1787790761.916107:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790761.917466:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236521600 00000100:00100000:0.0:1787790761.917478:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236521600 00000100:00100000:0.0:1787790761.917549:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 281 00000100:00100000:0.0:1787790761.917559:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45660c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+13:2346:x1874634236521600:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790761.918160:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45660c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+13:2346:x1874634236521600:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 600us (7774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790761.918169:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 281 00000100:00100000:2.0:1787790761.986785:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790761.987055:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236521856 00000100:00100000:1.0:1787790761.987066:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236521856 00000100:00100000:1.0:1787790761.987126:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:1.0:1787790761.987136:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d7921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+14:10304:x1874634236521856:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1787790761.987169:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790761.987201:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97745b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eaa6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.987270:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97745bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.987284:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97745bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.987297:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97745bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790761.987366:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787790761.987371:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787790761.987395:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97745bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.987422:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97745b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eaa6 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.987441:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97745bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eaa6 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.987448:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:1.0:1787790761.987451:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787790761.987454:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45705400, rc 0) 00000100:00100000:1.0:1787790761.987522:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d7921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+15:10304:x1874634236521856:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 388us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790761.987529:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:1.0:1787790761.991885:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790761.991981:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236522112 00000100:00100000:3.0:1787790761.991992:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236522112 00000100:00100000:3.0:1787790761.992090:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:3.0:1787790761.992100:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+15:10304:x1874634236522112:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1787790761.992126:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790761.992146:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa97745c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eaad expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790761.992255:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97745c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790761.992284:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97745c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790761.992296:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97745c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790761.992309:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787790761.992466:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa97745c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eaad expref: 18 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790761.992485:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97745c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eaad expref: 17 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790761.992493:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a49c31000) 00010000:00010000:3.0:1787790761.992496:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787790761.992499:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153a00, rc 0) 00000100:00100000:3.0:1787790761.992595:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+17:10304:x1874634236522112:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 497us (720us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787790761.992603:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:2.0:1787790761.996899:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790761.996941:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790761.997206:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236522368 00000100:00100000:1.0:1787790761.997216:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236522368 00000100:00100000:1.0:1787790761.997279:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:1.0:1787790761.997288:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5f9012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+17:10304:x1874634236522368:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1787790761.997324:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790761.997348:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa97745d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eab4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.997453:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa97745de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.997467:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa97745de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.997478:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa97745de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790761.997489:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787790761.997601:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa97745d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eab4 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.997621:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa97745de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eab4 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790761.997629:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a49c31000) 00010000:00010000:1.0:1787790761.997633:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787790761.997636:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45704400, rc 0) 00000100:00100000:1.0:1787790761.997698:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5f9012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+19:10304:x1874634236522368:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 410us (810us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787790761.997720:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:3.0:1787790761.998281:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236522496 00000100:00100000:3.0:1787790761.998287:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236522496 00000100:00100000:3.0:1787790761.998355:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:3.0:1787790761.998364:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+19:2349:x1874634236522496:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790761.998376:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790761.998395:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97745c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eaad expref: 19 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790761.998421:0:11653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a49c31000) 00010000:00010000:3.0:1787790761.998424:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790761.998457:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:2349:x1874634236522496:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 94us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790761.998464:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:2.0:1787790762.004620:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790762.004704:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236522624 00000100:00100000:3.0:1787790762.004715:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236522624 00000100:00100000:3.0:1787790762.004816:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:3.0:1787790762.004827:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2346:x1874634236522624:12345-192.168.201.25@tcp:1:lfs.0 00010000:00010000:3.0:1787790762.004872:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa97745ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.004894:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977459f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea98 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.004904:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790762.004908:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787790762.004913:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa97745ec lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.004951:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977459f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea98 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.004967:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977459f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea98 expref: 7 pid: 6684 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790762.005005:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a465a30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6683:1874634253331328:192.168.201.25@tcp:104: 00000100:00100000:3.0:1787790762.005096:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a45c24600 going to sleep for 11 seconds 00000100:00100000:0.0:1787790762.009239:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a465a30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6683:1874634253331328:192.168.201.25@tcp:104: 00010000:00010000:0.0:1787790762.009281:0:6683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa97745ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790762.010578:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790762.010699:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236522752 00000100:00100000:1.0:1787790762.010708:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236522752 00002000:00100000:1.0:1787790762.011134:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff931a465a0f00 x1874634236522752/t0(0) o4->3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp:603/0 lens 504/0 e 0 to 0 dl 1787790773 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787790762.011146:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a465a0f00 with x1874634236522752 ext(0->12) 00010000:00010000:1.0:1787790762.011155:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977459f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea98 expref: 8 pid: 6684 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.011168:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977459f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea98 expref: 8 pid: 6684 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787790762.011174:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff931a465a0f00 00000100:00100000:1.0:1787790762.011213:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:1.0:1787790762.011223:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2349:x1874634236522752:12345-192.168.201.25@tcp:4:lfs.0 00000001:00100000:2.0:1787790762.041246:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3e6e059d-f39a-42a8-9e93-fd30a950cc49 00000100:00100000:2.0:1787790762.042252:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:2349:x1874634236522752:12345-192.168.201.25@tcp:4:lfs.0 Request processed in 31023us (31672us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787790762.042270:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00002000:00100000:2.0:1787790762.042283:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff931a465a0f00 x1874634236522752/t4294967299(0) o4->3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp:603/0 lens 504/448 e 0 to 0 dl 1787790773 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787790762.042294:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a465a0f00 with x1874634236522752 ext(0->12) 00010000:00010000:2.0:1787790762.042303:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977459f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea98 expref: 9 pid: 6684 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.042322:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977459f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea98 expref: 9 pid: 6684 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787790762.042330:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff931a465a0f00 00000100:00100000:1.0:1787790762.046134:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790762.046255:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236522880 00000100:00100000:0.0:1787790762.046265:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236522880 00010000:00010000:0.0:1787790762.046307:0:8498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977459f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea98 expref: 9 pid: 6684 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790762.046351:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:0.0:1787790762.046361:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:2347:x1874634236522880:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790762.046377:0:8498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787790762.046395:0:8498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787790762.046398:0:8498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787790761 00002000:00010000:0.0:1787790762.046400:0:8498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787790762 00002000:00010000:0.0:1787790762.046402:0:8498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787790761 00010000:00010000:0.0:1787790762.046408:0:8498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977459f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea98 expref: 9 pid: 6684 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.046421:0:8498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977459f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea98 expref: 9 pid: 6684 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.046444:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977459f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea98 expref: 9 pid: 6684 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.046462:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787790762.046467:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787790762.046472:0:8498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa97745ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.046499:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa97745ec lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.046606:0:8498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790762.046664:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2347:x1874634236522880:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 304us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790762.046671:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 36 00010000:00010000:1.0:1787790762.047153:0:6683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa97745ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.047164:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa97745ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.047200:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa97745ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.047222:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa97745ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.047229:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa97745ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.047237:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152c00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790762.047241:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa97745ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.047251:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa97745ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.047266:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa97745ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.047273:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa97745ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790762.047417:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2346:x1874634236522624:12345-192.168.201.25@tcp:1:lfs.0 Request processed in 42591us (42809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790762.047425:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:1.0:1787790762.050064:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790762.050126:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236523136 00000100:00100000:2.0:1787790762.050135:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236523136 00000100:00100000:2.0:1787790762.050214:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:2.0:1787790762.050224:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:10304:x1874634236523136:12345-192.168.201.25@tcp:35:lfs.0 00000004:00010000:2.0:1787790762.050293:0:5850:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa97745de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eab4 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787790762.050579:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1787790762.050615:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1787790762.051174:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1787790762.051251:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97745f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.051267:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774583 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea8a expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.051275:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97745f3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.051317:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774583 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea8a expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.051331:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774583 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea8a expref: 22 pid: 5846 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790762.051344:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456da580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874634253331456:192.168.201.25@tcp:104: 00000100:00100000:2.0:1787790762.051435:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49772e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790762.053554:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456da580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874634253331456:192.168.201.25@tcp:104: 00010000:00010000:2.0:1787790762.053583:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97745f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790762.053928:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790762.053970:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236523264 00000100:00100000:0.0:1787790762.053978:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236523264 00010000:00010000:0.0:1787790762.054016:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774583 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea8a expref: 23 pid: 5846 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790762.054119:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00100000:0.0:1787790762.054130:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:2348:x1874634236523264:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790762.054154:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790762.054162:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774583 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea8a expref: 23 pid: 5846 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.054185:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774583 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea8a expref: 23 pid: 5846 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.054208:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774583 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea8a expref: 23 pid: 5846 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.054226:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a49c31000) 00010000:00010000:0.0:1787790762.054244:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97745f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.054253:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97745f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.054260:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97745f3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.054289:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790762.054351:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+22:2348:x1874634236523264:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 222us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790762.054358:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 37 00010000:00010000:2.0:1787790762.054461:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97745f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.054469:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97745f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787790762.054594:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787790762.054868:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1787790762.054988:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456da580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874634253331584:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787790762.055035:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790762.055076:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a45c24600 going to sleep for 11 seconds 00000100:00100000:1.0:1787790762.055293:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253331584 00000100:00100000:1.0:1787790762.055303:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253331584 00000100:00100000:1.0:1787790762.055373:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787790762.055381:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1874634253331584:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787790762.055451:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1874634253331584:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 72us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790762.055458:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787790762.055495:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456da580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874634253331584:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787790762.056168:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1787790762.056237:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbd2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874634253331712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787790762.056275:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790762.056299:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a44cd40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790762.056378:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253331712 00000100:00100000:2.0:1787790762.056383:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253331712 00000100:00100000:2.0:1787790762.056408:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787790762.056415:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1874634253331712:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1787790762.056437:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787790762.056587:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1874634253331712:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 172us (310us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787790762.056595:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787790762.056932:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbd2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874634253331712:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787790762.056981:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1787790762.057009:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97745f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.057017:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97745f3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.057022:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97745f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.057026:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654ec00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790762.057030:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97745f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.057036:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97745f3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.057062:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a49c31000) 00010000:00010000:1.0:1787790762.057065:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787790762.057070:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97745f3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.057076:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97745f3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787790762.057247:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787790762.057474:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1787790762.057482:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 296937758100ns, next at 297937756887ns, rc = 0 00000001:00080000:1.0:1787790762.057487:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1787790762.057509:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a49c31000) 00010000:00010000:1.0:1787790762.057511:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787790762.057516:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa97745de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eab4 expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790762.057635:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+25:10304:x1874634236523136:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 7413us (7582us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787790762.057648:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00000020:00080000:1.0:1787790762.057651:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787790762.060353:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790762.060448:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236523392 00000100:00100000:2.0:1787790762.060458:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236523392 00000100:00100000:2.0:1787790762.060550:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:2.0:1787790762.060560:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+25:10304:x1874634236523392:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1787790762.060584:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790762.060610:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97745fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eabb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.060992:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97745fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eabb expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.061009:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97745fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eabb expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.061031:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:2.0:1787790762.061034:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787790762.061038:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654ea00, rc 0) 00000100:00100000:2.0:1787790762.061118:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+26:10304:x1874634236523392:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 559us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790762.061125:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:3.0:1787790762.063566:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790762.063652:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236523648 00000100:00100000:1.0:1787790762.063663:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236523648 00000100:00100000:1.0:1787790762.063720:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:1.0:1787790762.063763:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4a6b9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+26:10304:x1874634236523648:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:1.0:1787790762.064014:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4a6b9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+27:10304:x1874634236523648:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 252us (456us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787790762.064034:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:1.0:1787790762.149559:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790762.149948:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236523904 00000100:00100000:3.0:1787790762.149961:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236523904 00000100:00100000:3.0:1787790762.150081:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:3.0:1787790762.150091:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+27:10314:x1874634236523904:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1787790762.150115:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790762.150138:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774601 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eac2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790762.150273:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787790762.150410:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774601 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eac2 expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.150426:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a49c31300) 00010000:00010000:3.0:1787790762.150429:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787790762.150436:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774601 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eac2 expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.150451:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153a00, rc 0) 00000100:00100000:3.0:1787790762.150522:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+28:10314:x1874634236523904:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 433us (975us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1787790762.150546:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:3.0:1787790762.155136:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790762.155484:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236524032 00000100:00100000:1.0:1787790762.155494:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236524032 00000100:00100000:1.0:1787790762.155553:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:1.0:1787790762.155563:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+28:10314:x1874634236524032:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:1.0:1787790762.155671:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa977460f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.155691:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa977460f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.155706:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa977460f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.155759:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774616 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.155768:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.155775:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.155906:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa977461d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.155916:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa977461d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.155922:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa977461d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790762.156006:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa977461d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.156024:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa977460f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.156031:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa977460f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.156039:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa977460f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.156045:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790762.156050:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa977460f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.156058:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa977460f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.156072:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:1.0:1787790762.156075:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790762.156081:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa977460f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.156087:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa977460f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.156104:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.156110:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774616 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.156122:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774616 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.156128:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790762.156131:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774616 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.156137:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774616 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.156145:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff931a488be800) 00010000:00010000:1.0:1787790762.156147:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790762.156149:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774616 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.156154:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774616 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.156172:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa977461d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.156188:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa977461d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.156193:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa977461d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.156197:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790762.156200:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa977461d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.156215:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa977461d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.156223:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:1.0:1787790762.156225:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790762.156228:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa977461d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.156234:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa977461d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790762.156325:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+28:10314:x1874634236524032:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 762us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790762.156333:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:1.0:1787790762.163279:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790762.163449:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236524288 00000100:00100000:3.0:1787790762.163458:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236524288 00000100:00100000:3.0:1787790762.163512:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:3.0:1787790762.163522:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+28:10314:x1874634236524288:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1787790762.164163:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+29:10314:x1874634236524288:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 280us (531us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787790762.164183:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:3.0:1787790762.199894:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790762.200022:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236524544 00000100:00100000:2.0:1787790762.200031:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236524544 00000100:00100000:2.0:1787790762.200095:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:2.0:1787790762.200105:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+29:10317:x1874634236524544:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1787790762.200127:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790762.200144:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774624 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eac9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200226:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa977462b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200240:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa977462b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200251:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa977462b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200265:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774632 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200271:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200277:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200553:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774639 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200578:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200585:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790762.200596:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787790762.200901:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa977462b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200907:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa977462b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200912:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa977462b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200915:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654fc00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790762.200918:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa977462b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200924:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa977462b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200934:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:2.0:1787790762.200935:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790762.200938:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa977462b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200943:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa977462b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200952:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200961:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774632 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200965:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774632 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200967:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790762.200969:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774632 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200972:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774632 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200976:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff931a4b7e7600) 00010000:00010000:2.0:1787790762.200978:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790762.200979:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774632 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.200982:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774632 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.201015:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774624 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eac9 expref: 32 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.201024:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eac9 expref: 31 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.201029:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:2.0:1787790762.201030:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790762.201035:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654f200, rc 0) 00000100:00100000:2.0:1787790762.201145:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+31:10317:x1874634236524544:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1042us (1262us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787790762.201151:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:1.0:1787790762.203927:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790762.204130:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236524672 00000100:00100000:3.0:1787790762.204139:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236524672 00000100:00100000:3.0:1787790762.204237:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:3.0:1787790762.204246:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+31:10317:x1874634236524672:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:3.0:1787790762.204327:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774647 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.204344:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774647 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.204355:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774647 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.204381:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774647 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.204388:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774647 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.204413:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774647 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.204419:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790762.204423:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774647 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.204431:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774647 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.204444:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:3.0:1787790762.204447:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787790762.204452:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774647 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.204459:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774647 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790762.204534:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+31:10317:x1874634236524672:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 288us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790762.204542:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:1.0:1787790762.207190:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790762.207256:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236524928 00000100:00100000:3.0:1787790762.207264:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236524928 00000100:00100000:3.0:1787790762.207320:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:3.0:1787790762.207328:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+31:10317:x1874634236524928:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1787790762.207561:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+32:10317:x1874634236524928:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 233us (388us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1787790762.207569:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:1.0:1787790762.498808:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790762.498894:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236525184 00000100:00100000:3.0:1787790762.498905:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236525184 00000100:00100000:3.0:1787790762.498968:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:3.0:1787790762.498978:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+32:10348:x1874634236525184:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:3.0:1787790762.499002:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790762.499024:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa977464e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ead0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.499126:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774655 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.499141:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774655 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.499153:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774655 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790762.499164:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787790762.500642:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa977464e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ead0 expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.500836:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774655 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ead0 expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.500846:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:3.0:1787790762.500849:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787790762.500853:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153a00, rc 0) 00000100:00100000:3.0:1787790762.500938:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+34:10348:x1874634236525184:12345-192.168.201.25@tcp:101:cat.0 Request processed in 1961us (2138us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787790762.500964:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:1.0:1787790762.505575:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790762.505847:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236525312 00000100:00100000:3.0:1787790762.505855:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236525312 00000100:00100000:3.0:1787790762.505964:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:3.0:1787790762.506031:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a493cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+34:2347:x1874634236525312:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790762.506048:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790762.506068:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774655 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ead0 expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.506083:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:3.0:1787790762.506087:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790762.506135:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a493cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+33:2347:x1874634236525312:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 163us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790762.506142:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:0.0:1787790762.509649:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790762.509848:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236525568 00000100:00100000:3.0:1787790762.509858:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236525568 00000100:00100000:2.0:1787790762.509924:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:2.0:1787790762.509937:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+33:10348:x1874634236525568:12345-192.168.201.25@tcp:35:cat.0 00000100:00100000:2.0:1787790762.510584:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+34:10348:x1874634236525568:12345-192.168.201.25@tcp:35:cat.0 Request processed in 647us (941us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787790762.510593:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:1.0:1787790762.574063:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790762.574288:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236525824 00000100:00100000:2.0:1787790762.574296:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236525824 00000100:00100000:2.0:1787790762.574354:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:2.0:1787790762.574363:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+34:10354:x1874634236525824:12345-192.168.201.25@tcp:101:dd.0 00010000:00010000:2.0:1787790762.574622:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790762.574626:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787790762.574653:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97745bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eaa6 expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.574884:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:2.0:1787790762.574889:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790762.574905:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774663 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ead7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.575018:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977466a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.575032:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774639 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eac9 expref: 34 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.575052:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977466a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.575079:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eac9 expref: 34 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.575089:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774639 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eac9 expref: 34 pid: 5848 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790762.575099:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456dbc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874634253331840:192.168.201.25@tcp:104: 00000100:00100000:2.0:1787790762.575538:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82240 going to sleep for 11 seconds 00000100:00100000:2.0:1787790762.578757:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456dbc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874634253331840:192.168.201.25@tcp:104: 00010000:00010000:2.0:1787790762.578868:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977466a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790762.580601:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790762.581024:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236525952 00000100:00100000:0.0:1787790762.581032:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236525952 00010000:00010000:0.0:1787790762.581068:0:8498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774639 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eac9 expref: 35 pid: 5848 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790762.581100:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:0.0:1787790762.581106:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+35:2348:x1874634236525952:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790762.581118:0:8498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790762.581123:0:8498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774639 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eac9 expref: 35 pid: 5848 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.581132:0:8498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eac9 expref: 35 pid: 5848 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.581149:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774639 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eac9 expref: 35 pid: 5848 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.581184:0:8498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:0.0:1787790762.581193:0:8498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977466a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.581203:0:8498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977466a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.581210:0:8498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977466a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.581295:0:8498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790762.581358:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+34:2348:x1874634236525952:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 251us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790762.581365:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 38 00010000:00010000:2.0:1787790762.582248:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977466a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.582258:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977466a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790762.582276:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787790762.582506:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774663 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ead7 expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.582519:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977466a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ead7 expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.582536:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:2.0:1787790762.582538:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787790762.582540:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654f400, rc 0) 00000100:00100000:2.0:1787790762.583489:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+34:10354:x1874634236525824:12345-192.168.201.25@tcp:101:dd.0 Request processed in 9121us (9430us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1787790762.583499:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:1.0:1787790762.586599:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790762.586687:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236526208 00000100:00100000:2.0:1787790762.586697:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236526208 00000100:00100000:2.0:1787790762.586794:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:2.0:1787790762.586804:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+34:10354:x1874634236526208:12345-192.168.201.25@tcp:36:dd.0 00010000:00010000:2.0:1787790762.587093:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774678 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.587111:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774678 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790762.587124:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774678 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787790762.587389:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1787790762.587419:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010a12936 reply state 000000006b4831ed transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774678 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790762.587428:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787790762.587523:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+37:10354:x1874634236526208:12345-192.168.201.25@tcp:36:dd.0 Request processed in 720us (935us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787790762.587531:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 52 00000020:00080000:2.0:1787790762.587550:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787790762.589566:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774678 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.589582:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774678 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.589590:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774678 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.589596:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654fc00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790762.589601:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774678 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.589625:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774678 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.589651:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:3.0:1787790762.589655:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790762.589659:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774678 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.589664:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774678 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.752060:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790762.840866:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790762.840977:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236526336 00000100:00100000:3.0:1787790762.840988:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236526336 00000100:00100000:3.0:1787790762.841096:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 53 00000100:00100000:3.0:1787790762.841107:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+36:10368:x1874634236526336:12345-192.168.201.25@tcp:101:stat.0 00010000:00010000:3.0:1787790762.841132:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790762.841151:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa977467f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eade expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.841232:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774686 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.841246:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774686 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.841258:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774686 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.841271:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa977468d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.841288:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa977468d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.841295:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa977468d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.841391:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774694 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.841403:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977466a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ead7 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.841412:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774694 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.841445:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977466a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ead7 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790762.841458:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977466a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ead7 expref: 37 pid: 5846 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790762.841470:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a465a2580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1874634253331968:192.168.201.25@tcp:104: 00000100:00100000:3.0:1787790762.841565:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a42f60b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787790762.843628:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790762.843760:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a465a2580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1874634253331968:192.168.201.25@tcp:104: 00010000:00010000:3.0:1787790762.843785:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774694 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790762.843934:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236526592 00000100:00100000:0.0:1787790762.843940:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236526592 00000100:00100000:0.0:1787790762.843993:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:0.0:1787790762.844002:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+38:5583:x1874634236526592:12345-192.168.201.25@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787790762.844371:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+39:5583:x1874634236526592:12345-192.168.201.25@tcp:35:ldlm_bl.0 Request processed in 369us (750us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1787790762.844379:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:1.0:1787790762.846606:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790762.846846:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236526720 00000100:00100000:0.0:1787790762.846855:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236526720 00010000:00010000:0.0:1787790762.846891:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977466a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ead7 expref: 39 pid: 5846 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790762.846985:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:0.0:1787790762.846994:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be28b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+39:2349:x1874634236526720:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790762.847008:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790762.847014:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977466a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ead7 expref: 39 pid: 5846 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.847026:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977466a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ead7 expref: 39 pid: 5846 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.847047:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa977466a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ead7 expref: 39 pid: 5846 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.847063:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:0.0:1787790762.847069:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774694 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.847078:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.847086:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774694 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790762.847116:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790762.847185:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be28b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+38:2349:x1874634236526720:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 192us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790762.847193:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 39 00010000:00010000:1.0:1787790762.847244:0:7920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.847252:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790762.847298:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787790762.847302:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787790762.847340:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.847353:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.847361:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774686 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.847368:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774686 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.847375:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774686 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.847380:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790762.847384:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774686 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.847391:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774686 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.847400:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:1.0:1787790762.847403:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790762.847407:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774686 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.847413:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774686 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.847434:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa977468d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.847441:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa977468d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.847448:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa977468d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.847453:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790762.847457:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa977468d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.847464:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa977468d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.847482:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff931a541adf00) 00010000:00010000:1.0:1787790762.847485:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790762.847489:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa977468d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.847495:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa977468d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.847528:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa977467f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eade expref: 38 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.847541:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eade expref: 37 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.847560:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:1.0:1787790762.847563:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787790762.847566:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153000, rc 0) 00000100:00100000:1.0:1787790762.847589:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+37:10368:x1874634236526336:12345-192.168.201.25@tcp:101:stat.0 Request processed in 6485us (6733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790762.847597:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 53 00000100:00100000:3.0:1787790762.902910:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790762.903515:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236526976 00000100:00100000:1.0:1787790762.903528:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236526976 00000100:00100000:1.0:1787790762.903787:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 54 00000100:00100000:1.0:1787790762.903800:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+37:10374:x1874634236526976:12345-192.168.201.25@tcp:36:truncate.0 00010000:00010000:1.0:1787790762.903882:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790762.903918:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774694 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eade expref: 37 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.903942:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:1.0:1787790762.903950:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790762.904403:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa977469b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.904421:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa977469b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.904434:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa977469b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787790762.904495:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1787790762.904532:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000309afb60 reply state 000000002f19fe94 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa977469b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790762.904556:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787790762.904976:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+39:10374:x1874634236526976:12345-192.168.201.25@tcp:36:truncate.0 Request processed in 1176us (2078us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1787790762.904986:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 54 00000020:00080000:1.0:1787790762.904998:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787790762.907480:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa977469b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.907503:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa977469b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.907513:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa977469b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.907520:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790762.907526:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa977469b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.907534:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa977469b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.907556:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:1.0:1787790762.907560:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790762.907566:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa977469b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790762.907573:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa977469b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790763.039533:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790763.040212:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236527104 00000100:00100000:2.0:1787790763.040226:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236527104 00000100:00100000:2.0:1787790763.040390:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00100000:2.0:1787790763.040404:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+38:10389:x1874634236527104:12345-192.168.201.25@tcp:101:stat.0 00010000:00010000:2.0:1787790763.040439:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790763.040468:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa97746a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eae5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.040558:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97746a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.040576:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97746a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.040589:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97746a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.040605:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.040612:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.040617:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.040801:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa97746b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.040810:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa97746b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.040837:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa97746b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790763.040884:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787790763.040889:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787790763.040919:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa97746b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.040932:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa97746b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.040941:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97746a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.040948:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97746a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.040956:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97746a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.040962:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654e200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790763.040967:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97746a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.040976:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97746a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.040989:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:2.0:1787790763.040992:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790763.040998:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97746a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.041016:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97746a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.041035:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.041041:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.041046:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.041051:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654e000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790763.041054:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.041060:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.041067:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff931a4b7e7600) 00010000:00010000:2.0:1787790763.041069:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790763.041072:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.041078:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.041114:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa97746a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eae5 expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.041128:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa97746b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eae5 expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.041142:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:2.0:1787790763.041144:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790763.041147:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654f000, rc 0) 00000100:00100000:2.0:1787790763.041239:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+39:10389:x1874634236527104:12345-192.168.201.25@tcp:101:stat.0 Request processed in 839us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790763.041247:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00080000:3.0:1787790763.041325:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790763.123909:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790763.124142:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236527360 00000100:00100000:3.0:1787790763.124150:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236527360 00000100:00100000:3.0:1787790763.124223:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:3.0:1787790763.124232:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+39:10399:x1874634236527360:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1787790763.124249:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790763.124267:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97746be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eaec expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790763.124381:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787790763.124497:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97746be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eaec expref: 41 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.124520:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a49c31300) 00010000:00010000:3.0:1787790763.124523:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787790763.124529:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97746be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eaec expref: 41 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.124544:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153e00, rc 0) 00000100:00100000:3.0:1787790763.124616:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+40:10399:x1874634236527360:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 384us (718us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1787790763.124624:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:0.0:1787790763.128077:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790763.128201:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236527616 00000100:00100000:3.0:1787790763.128210:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236527616 00000100:00100000:3.0:1787790763.128276:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:3.0:1787790763.128285:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+40:10399:x1874634236527616:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1787790763.128559:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+41:10399:x1874634236527616:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 274us (491us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1787790763.128567:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:0.0:1787790763.194415:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790763.194710:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236527872 00000100:00100000:1.0:1787790763.194770:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236527872 00000100:00100000:1.0:1787790763.194890:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:1.0:1787790763.194901:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+41:10405:x1874634236527872:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1787790763.194925:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790763.194947:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97746cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eaf3 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.195062:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97746d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.195077:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa97746b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eae5 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.195087:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97746d3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.195117:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa97746b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eae5 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.195127:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa97746b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eae5 expref: 42 pid: 5846 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790763.195137:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be28f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1874634253332096:192.168.201.25@tcp:104: 00000100:00100000:1.0:1787790763.195238:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49772e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790763.204569:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790763.204667:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236528000 00000100:00100000:3.0:1787790763.204675:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236528000 00010000:00010000:3.0:1787790763.204758:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa97746b7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eae5 expref: 43 pid: 5846 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790763.204792:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:3.0:1787790763.204802:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+43:2349:x1874634236528000:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790763.204817:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790763.204824:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa97746b7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eae5 expref: 43 pid: 5846 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.204836:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa97746b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eae5 expref: 43 pid: 5846 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.204859:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:3.0:1787790763.204865:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97746d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.204875:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97746d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.204883:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97746d3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.204903:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790763.204975:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+43:2349:x1874634236528000:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 175us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790763.204984:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 40 00010000:00010000:1.0:1787790763.205819:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa97746b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eae5 expref: 42 pid: 5846 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790763.205842:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be28f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1874634253332096:192.168.201.25@tcp:104: 00010000:00010000:1.0:1787790763.205874:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97746d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.205884:0:7920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97746d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.205890:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97746d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790763.205910:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1787790763.206078:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97746cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eaf3 expref: 43 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.206094:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97746d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eaf3 expref: 42 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.206102:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:1.0:1787790763.206104:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787790763.206108:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45705800, rc 0) 00000100:00100000:1.0:1787790763.206165:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+42:10405:x1874634236527872:12345-192.168.201.25@tcp:101:bash.0 Request processed in 11258us (11754us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1787790763.206173:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:2.0:1787790763.208808:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790763.210087:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236528256 00000100:00100000:3.0:1787790763.210101:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236528256 00000100:00100000:3.0:1787790763.210236:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 58 00000100:00100000:3.0:1787790763.210246:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+42:10405:x1874634236528256:12345-192.168.201.25@tcp:36:bash.0 00010000:00010000:3.0:1787790763.210742:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97746e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.210759:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97746e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.210770:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97746e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787790763.210816:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1787790763.210838:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057ec7ed7 reply state 00000000ca73f6c5 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97746e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790763.210847:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787790763.211000:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+45:10405:x1874634236528256:12345-192.168.201.25@tcp:36:bash.0 Request processed in 755us (2202us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1787790763.211008:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 58 00000020:00080000:3.0:1787790763.211013:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787790763.217204:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790763.217407:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236528384 00000100:00100000:2.0:1787790763.217417:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236528384 00000100:00100000:2.0:1787790763.217595:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:2.0:1787790763.217606:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+45:10405:x1874634236528384:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:2.0:1787790763.217694:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790763.217791:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97746e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eafa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.217877:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.217892:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97746d3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eaf3 expref: 46 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.217899:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97746e1 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.217907:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746ef lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.217940:0:5846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97746e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.218023:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97746d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eaf3 expref: 46 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.218039:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97746d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eaf3 expref: 46 pid: 7920 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790763.218053:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befda40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874634253332224:192.168.201.25@tcp:104: 00000100:00100000:2.0:1787790763.218133:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4cbf73c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787790763.218282:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97746e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.218290:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97746e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.218308:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97746e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.218314:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790763.218318:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97746e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.218326:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97746e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.218590:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:3.0:1787790763.218595:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790763.218598:0:3304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.218608:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97746e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.218614:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97746e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790763.220310:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befda40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874634253332224:192.168.201.25@tcp:104: 00010000:00010000:3.0:1787790763.220343:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790763.222331:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790763.222899:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236528512 00000100:00100000:3.0:1787790763.222908:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236528512 00010000:00010000:3.0:1787790763.222951:0:11653:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97746d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eaf3 expref: 46 pid: 7920 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790763.223022:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 41 00000100:00100000:3.0:1787790763.223032:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+46:2348:x1874634236528512:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790763.223048:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790763.223055:0:11653:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97746d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eaf3 expref: 46 pid: 7920 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.223068:0:11653:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97746d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eaf3 expref: 46 pid: 7920 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.223090:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97746d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eaf3 expref: 46 pid: 7920 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.223106:0:11653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:3.0:1787790763.223111:0:11653:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.223121:0:11653:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.223127:0:11653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746ef lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.223255:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790763.223314:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+45:2348:x1874634236528512:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 283us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790763.223323:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 41 00010000:00010000:2.0:1787790763.224391:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.224403:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790763.224450:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787790763.224455:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787790763.224586:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.224623:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97746e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eafa expref: 45 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.224947:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eafa expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.224974:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:2.0:1787790763.224977:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790763.224980:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654e000, rc 0) 00000100:00100000:2.0:1787790763.225076:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+44:10405:x1874634236528384:12345-192.168.201.25@tcp:101:bash.0 Request processed in 7470us (7879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790763.225085:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:0.0:1787790763.228224:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790763.228299:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236528768 00000100:00100000:3.0:1787790763.228332:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236528768 00000100:00100000:3.0:1787790763.228398:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:3.0:1787790763.228407:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4a6ba450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+44:10405:x1874634236528768:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:3.0:1787790763.228671:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4a6ba450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+45:10405:x1874634236528768:12345-192.168.201.25@tcp:35:bash.0 Request processed in 265us (458us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1787790763.228680:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:0.0:1787790763.307252:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790763.309112:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236529024 00000100:00100000:1.0:1787790763.309127:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236529024 00000100:00100000:1.0:1787790763.309208:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:1.0:1787790763.309218:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+45:10415:x1874634236529024:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1787790763.309242:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790763.309265:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97746f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb01 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790763.309408:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787790763.309533:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97746f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb01 expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.309547:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a49c31300) 00010000:00010000:1.0:1787790763.309549:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787790763.309554:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97746f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb01 expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.309568:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45705200, rc 0) 00000100:00100000:1.0:1787790763.309962:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+46:10415:x1874634236529024:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 745us (2719us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1787790763.309975:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:2.0:1787790763.317148:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790763.317255:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236529152 00000100:00100000:1.0:1787790763.317265:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236529152 00000100:00100000:1.0:1787790763.317361:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:1.0:1787790763.317370:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+46:10415:x1874634236529152:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:1.0:1787790763.317444:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774704 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.317460:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774704 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.317472:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774704 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.317486:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa977470b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.317519:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa977470b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.317526:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa977470b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.317638:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774712 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.317647:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.317654:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790763.317696:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.317709:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774704 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.317954:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774704 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.317962:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774704 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.317969:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790763.317973:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774704 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.317981:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774704 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.318006:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:1.0:1787790763.318009:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790763.318015:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774704 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.318022:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774704 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.318034:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa977470b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.318040:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa977470b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.318046:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa977470b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.318051:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790763.318054:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa977470b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.318060:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa977470b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.318068:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff931a488be800) 00010000:00010000:1.0:1787790763.318070:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790763.318073:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa977470b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.318079:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa977470b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.318107:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.318113:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774712 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.318119:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774712 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.318124:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790763.318127:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774712 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.318133:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774712 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.318140:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:1.0:1787790763.318143:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790763.318145:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774712 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.318151:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774712 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790763.318246:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+46:10415:x1874634236529152:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 875us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790763.318255:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:0.0:1787790763.322001:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790763.322145:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236529408 00000100:00100000:3.0:1787790763.322166:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236529408 00000100:00100000:3.0:1787790763.326581:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:3.0:1787790763.326609:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+46:10415:x1874634236529408:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1787790763.327089:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+47:10415:x1874634236529408:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 491us (5095us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1787790763.327098:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:0.0:1787790763.381007:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790763.381223:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236529664 00000100:00100000:3.0:1787790763.381233:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236529664 00000100:00100000:3.0:1787790763.381296:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 62 00000100:00100000:3.0:1787790763.381306:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+47:10418:x1874634236529664:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1787790763.381330:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790763.381349:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774719 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb08 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381427:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774720 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381442:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774720 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381453:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774720 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381482:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774727 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381490:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381496:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381647:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa977472e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381657:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa977472e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381665:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa977472e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790763.381674:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787790763.381816:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774720 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381824:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774720 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381830:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774720 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381835:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790763.381839:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774720 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381859:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774720 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381871:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:3.0:1787790763.381874:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790763.381878:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774720 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381884:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774720 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381899:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381905:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774727 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381911:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774727 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381916:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790763.381919:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774727 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381925:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774727 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381931:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff931a541ad700) 00010000:00010000:3.0:1787790763.381933:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790763.381936:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774727 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381951:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774727 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.381994:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774719 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb08 expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.382008:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa977472e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb08 expref: 49 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.382016:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:3.0:1787790763.382018:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787790763.382021:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153800, rc 0) 00000100:00100000:3.0:1787790763.382078:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+49:10418:x1874634236529664:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 772us (1080us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1787790763.382086:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 62 00000100:00100000:2.0:1787790763.392342:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790763.392403:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790763.392508:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236529920 00000100:00100000:0.0:1787790763.392518:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236529920 00000100:00100000:0.0:1787790763.392590:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:0.0:1787790763.392600:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+49:2349:x1874634236529920:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790763.392616:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790763.392647:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa977472e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb08 expref: 49 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.392661:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:0.0:1787790763.392665:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790763.392711:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+48:2349:x1874634236529920:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 114us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790763.392716:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:3.0:1787790763.393125:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236529792 00000100:00100000:3.0:1787790763.393129:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236529792 00000100:00100000:3.0:1787790763.393174:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:3.0:1787790763.393181:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+48:10418:x1874634236529792:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:3.0:1787790763.393233:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa977473c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.393245:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa977473c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.393253:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa977473c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.393289:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa977473c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.393293:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa977473c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.393297:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa977473c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.393301:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790763.393304:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa977473c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.393309:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa977473c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.393314:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:3.0:1787790763.393316:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787790763.393318:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa977473c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.393322:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa977473c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790763.393369:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+48:10418:x1874634236529792:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 188us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790763.393376:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:2.0:1787790763.402034:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790763.402207:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236530176 00000100:00100000:1.0:1787790763.402215:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236530176 00000100:00100000:1.0:1787790763.402262:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:1.0:1787790763.402276:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+48:10418:x1874634236530176:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:1.0:1787790763.402496:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+49:10418:x1874634236530176:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 219us (480us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787790763.402505:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:2.0:1787790763.564644:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790763.564803:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236530432 00000100:00100000:3.0:1787790763.564812:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236530432 00000100:00100000:3.0:1787790763.564878:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:3.0:1787790763.564902:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+49:10436:x1874634236530432:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:3.0:1787790763.564925:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790763.564945:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774743 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb0f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.565052:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa977474a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.565065:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa977474a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.565075:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa977474a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790763.565086:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787790763.567318:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774743 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb0f expref: 52 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.567343:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa977474a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb0f expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.567350:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:3.0:1787790763.567352:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787790763.567354:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153a00, rc 0) 00000100:00100000:3.0:1787790763.567417:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+51:10436:x1874634236530432:12345-192.168.201.25@tcp:101:cat.0 Request processed in 2517us (2794us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1787790763.567425:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:2.0:1787790763.591652:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790763.591958:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236530560 00000100:00100000:3.0:1787790763.592077:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236530560 00000100:00100000:2.0:1787790763.592254:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 65 00000100:00100000:2.0:1787790763.592264:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+51:10437:x1874634236530560:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1787790763.592285:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790763.592307:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774758 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb16 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.592383:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa977475f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.592397:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa977475f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.592408:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa977475f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790763.592485:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787790763.592489:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787790763.592520:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa977475f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.592546:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774758 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb16 expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.592564:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa977475f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb16 expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.592573:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:2.0:1787790763.592576:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790763.592579:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654f200, rc 0) 00000100:00100000:2.0:1787790763.592635:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+52:10437:x1874634236530560:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 373us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790763.592642:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 65 00000100:00100000:2.0:1787790763.596262:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790763.598203:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236530944 00000100:00100000:1.0:1787790763.598218:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236530944 00000100:00100000:1.0:1787790763.598323:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:1.0:1787790763.598350:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+52:10437:x1874634236530944:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:1.0:1787790763.598694:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+53:10437:x1874634236530944:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 346us (2439us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787790763.598702:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:3.0:1787790763.600767:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790763.603658:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236531072 00000100:00100000:0.0:1787790763.603672:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236531072 00000100:00100000:0.0:1787790763.603769:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:0.0:1787790763.603779:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+53:10437:x1874634236531072:12345-192.168.201.25@tcp:103:lfs.0 00010000:00010000:0.0:1787790763.603795:0:8498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787790763.603818:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa97746ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eafa expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.603864:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa977474a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb0f expref: 52 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.603876:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97745fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eabb expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.603885:0:8498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7d00) 00010000:00010000:0.0:1787790763.603895:0:8498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790763.603962:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+50:10437:x1874634236531072:12345-192.168.201.25@tcp:103:lfs.0 Request processed in 184us (3237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790763.604295:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:2.0:1787790763.606122:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790763.606204:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236531200 00000100:00100000:1.0:1787790763.606212:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236531200 00000100:00100000:1.0:1787790763.606259:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 66 00000100:00100000:1.0:1787790763.606267:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+50:10437:x1874634236531200:12345-192.168.201.25@tcp:58:lfs.0 00010000:00010000:1.0:1787790763.606386:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774766 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.606402:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774766 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.606412:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774766 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787790763.606872:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787790763.607187:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787790763.607253:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787790763.607697:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+50:10437:x1874634236531200:12345-192.168.201.25@tcp:58:lfs.0 Request processed in 1427us (1580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790763.607714:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 66 00000100:00100000:1.0:1787790763.625253:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790763.625429:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236531328 00000100:00100000:0.0:1787790763.625439:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236531328 00000100:00100000:0.0:1787790763.625558:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:0.0:1787790763.625569:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+50:10439:x1874634236531328:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1787790763.625588:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790763.625609:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa977476d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb1d expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.625674:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa9774774 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.625688:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa9774774 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.625698:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa9774774 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.625777:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa977477b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.625786:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa977477b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.625792:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa977477b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.625893:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774782 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.625902:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.625909:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790763.625945:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787790763.625949:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787790763.625975:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.625988:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.625996:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa9774774 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.626002:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa9774774 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.626221:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa9774774 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.626227:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790763.626232:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa9774774 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.626239:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa9774774 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.626251:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:0.0:1787790763.626254:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790763.626259:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa9774774 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.626265:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa9774774 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.626279:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa977477b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.626285:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa977477b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.626291:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa977477b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.626296:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790763.626299:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa977477b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.626316:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa977477b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.626324:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff931a49c31500) 00010000:00010000:0.0:1787790763.626335:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790763.626339:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa977477b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.626345:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa977477b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.626377:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa977476d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb1d expref: 52 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.626391:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774782 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb1d expref: 51 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.626397:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a488be800) 00010000:00010000:0.0:1787790763.626399:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787790763.626402:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41479800, rc 0) 00000100:00100000:0.0:1787790763.626475:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+51:10439:x1874634236531328:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 908us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790763.626483:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 67 00000040:00080000:3.0:1787790763.712875:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787790763.712883:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787790763.712939:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787790763.712946:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787790763.713069:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874634253332352:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787790763.713241:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a42f60b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790763.721088:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790763.721207:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a45dbe940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874634253332352:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787790763.721351:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236531456 00000100:00100000:0.0:1787790763.721357:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236531456 00000100:00100000:0.0:1787790763.721412:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:0.0:1787790763.721421:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+51:10450:x1874634236531456:12345-192.168.201.25@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787790763.721501:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+51:10450:x1874634236531456:12345-192.168.201.25@tcp:900:lhsmtool_posix.0 Request processed in 81us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790763.721509:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:0.0:1787790763.723073:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790763.725896:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236531584 00000100:00100000:3.0:1787790763.725908:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236531584 00000100:00100000:3.0:1787790763.726012:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:3.0:1787790763.726024:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+51:10450:x1874634236531584:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787790763.726054:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787790763.726188:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+51:10450:x1874634236531584:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 166us (3122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790763.726196:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:0.0:1787790763.730096:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790763.730193:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236531712 00000100:00100000:2.0:1787790763.730204:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236531712 00000100:00100000:2.0:1787790763.730410:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:2.0:1787790763.730422:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+51:10450:x1874634236531712:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787790763.730492:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774789 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730521:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774789 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730538:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774789 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730601:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774790 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730608:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774790 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730615:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774790 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730641:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774797 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730650:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730657:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790763.730695:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787790763.730699:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787790763.730711:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730741:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774789 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730748:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774789 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730765:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774789 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730771:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790763.730775:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774789 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730783:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774789 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730796:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff931a4b7e7200) 00010000:00010000:2.0:1787790763.730799:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790763.730803:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774789 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730809:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774789 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730820:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774790 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730827:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774790 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730832:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774790 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730837:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654fe00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790763.730840:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774790 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730857:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774790 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730865:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff931a4b7e7600) 00010000:00010000:2.0:1787790763.730867:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790763.730870:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774790 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730875:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774790 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730889:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730895:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774797 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730901:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774797 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730906:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654e200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790763.730909:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774797 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730914:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774797 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730920:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a488be800) 00010000:00010000:2.0:1787790763.730923:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790763.730925:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774797 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.730940:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774797 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790763.731020:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+51:10450:x1874634236531712:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 Request processed in 601us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790763.731029:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:3.0:1787790763.737254:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790763.737350:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236531968 00000100:00100000:0.0:1787790763.737360:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236531968 00000100:00100000:0.0:1787790763.737419:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:0.0:1787790763.737429:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c26b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+51:10450:x1874634236531968:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787790763.737451:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790763.737470:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977479e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb24 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.737572:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97747a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.737589:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97747a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.737600:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97747a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790763.737611:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787790763.737704:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97747a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.737757:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97747a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.737775:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97747a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.737782:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790763.737786:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97747a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.737794:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97747a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.737806:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a488be800) 00010000:00010000:0.0:1787790763.737809:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787790763.737813:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97747a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.737819:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97747a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.737867:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977479e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb24 expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.737877:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff931a4b7e7200) 00010000:00010000:0.0:1787790763.737880:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787790763.737884:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977479e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb24 expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.737893:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41478800, rc 0) 00000100:00100000:0.0:1787790763.737947:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c26b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+52:10450:x1874634236531968:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 520us (704us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1787790763.737963:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:0.0:1787790763.741174:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790763.741421:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236532096 00000100:00100000:1.0:1787790763.741431:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236532096 00000100:00100000:1.0:1787790763.741491:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 71 00000100:00100000:1.0:1787790763.741511:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+52:10450:x1874634236532096:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787790763.741544:0:7920:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787790763.741655:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+52:10450:x1874634236532096:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 146us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790763.741663:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 71 00000100:00100000:0.0:1787790763.747491:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790763.747657:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236532352 00000100:00100000:1.0:1787790763.747666:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236532352 00000100:00100000:1.0:1787790763.747749:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 72 00000100:00100000:1.0:1787790763.747759:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+52:10450:x1874634236532352:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790763.747781:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790763.747784:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787790763.747810:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa977475f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb16 expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.747826:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:1.0:1787790763.747831:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790763.747844:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97747b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb2b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787790763.748253:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1787790763.748468:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa97747ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.748490:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa97747ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.748499:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa97747ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.748554:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97747b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb2b expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.748569:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa97747ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb2b expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.748577:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff931a488be700) 00010000:00010000:1.0:1787790763.748580:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787790763.748583:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45704e00, rc 0) 00000100:00100000:1.0:1787790763.748641:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+53:10450:x1874634236532352:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 884us (1160us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787790763.748649:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 72 00000100:00100000:3.0:1787790763.751515:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790763.751600:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236532608 00000100:00100000:2.0:1787790763.751610:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236532608 00000100:00100000:2.0:1787790763.751668:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 73 00000100:00100000:2.0:1787790763.751677:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+53:10450:x1874634236532608:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787790763.751756:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790763.751782:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa97747ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb2b expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.751799:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff931a488be700) 00010000:00010000:2.0:1787790763.751809:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790763.751832:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97747c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.751846:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97747c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.751856:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97747c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.751917:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa97747cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x6656589f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.751925:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa97747cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6656589f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.751939:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa97747cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6656589f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.752012:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97747c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.752017:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97747c8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.752021:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97747c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.752025:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654e200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790763.752028:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97747c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.752033:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97747c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.752038:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:2.0:1787790763.752040:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790763.752042:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97747c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.752046:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97747c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.752052:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa97747cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6656589f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.752056:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa97747cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6656589f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.752064:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa97747cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6656589f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.752067:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654fe00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790763.752069:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa97747cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6656589f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.752072:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa97747cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6656589f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.752076:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x6656589f (ffff931a4b7e7600) 00010000:00010000:2.0:1787790763.752078:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790763.752079:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa97747cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6656589f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790763.752082:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa97747cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6656589f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790763.752157:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+52:10450:x1874634236532608:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 471us (643us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787790763.752165:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 73 00000100:00100000:2.0:1787790763.755812:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790763.755953:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236532736 00000100:00100000:3.0:1787790763.755963:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236532736 00000100:00100000:3.0:1787790763.756013:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 74 00000100:00100000:3.0:1787790763.756021:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+52:10450:x1874634236532736:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787790763.756040:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790763.756061:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97747d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb32 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.756093:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa97747dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.756115:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa97747dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.756126:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa97747dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.756221:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97747d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb32 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.756237:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa97747dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb32 expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.756245:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff931a541ad700) 00010000:00010000:3.0:1787790763.756247:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787790763.756250:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153000, rc 0) 00000100:00100000:3.0:1787790763.756297:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+53:10450:x1874634236532736:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 278us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790763.756304:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 74 00000100:00100000:0.0:1787790763.768603:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790763.768758:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236532992 00000100:00100000:1.0:1787790763.768767:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236532992 00000100:00100000:1.0:1787790763.768829:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 75 00000100:00100000:1.0:1787790763.768838:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+53:10450:x1874634236532992:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787790763.768920:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97747e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.768938:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97747e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.768963:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97747e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787790763.769243:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1787790763.769253:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 298649528740ns, next at 299649526433ns, rc = 0 00000004:00010000:1.0:1787790763.769406:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078895389 reply state 00000000578eb80f transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97747e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790763.769416:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787790763.769593:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+55:10450:x1874634236532992:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 754us (996us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1787790763.769601:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 75 00000100:00100000:0.0:1787790763.775705:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00010000:00010000:3.0:1787790763.775905:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97747e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.775918:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97747e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.775926:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97747e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.775933:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790763.775937:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97747e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.775954:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97747e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.775971:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff931a541ad700) 00010000:00010000:3.0:1787790763.775973:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787790763.775979:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97747e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.775985:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa97747e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790763.776013:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236533120 00000100:00100000:3.0:1787790763.776021:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236533120 00000100:00100000:3.0:1787790763.776173:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 76 00000100:00100000:3.0:1787790763.776183:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+54:10450:x1874634236533120:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787790763.776204:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790763.776219:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97747eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb39 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.776277:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97747eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb39 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.776290:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97747eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb39 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.776307:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff931a541ad700) 00010000:00010000:3.0:1787790763.776310:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787790763.776312:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153e00, rc 0) 00000100:00100000:3.0:1787790763.776372:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+55:10450:x1874634236533120:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 191us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790763.776381:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 76 00010000:00010000:2.0:1787790763.777088:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790763.781242:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790763.781307:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236533248 00000100:00100000:3.0:1787790763.781317:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236533248 00000100:00100000:3.0:1787790763.781449:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:3.0:1787790763.781456:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1874634236533248:12345-192.168.201.25@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787790763.781486:0:6685:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp t0 exp 0000000000000000 cur 298 last 0 00000020:00000080:3.0:1787790763.781515:0:6685:0:(genops.c:1385:class_connect()) connect: client 3e6e059d-f39a-42a8-9e93-fd30a950cc49, cookie 0x70647b5fa97747f2 00002000:00100000:3.0:1787790763.781528:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3e6e059d-f39a-42a8-9e93-fd30a950cc49/ffff931a4ae3e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787790763.781551:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787790763.781796:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787790763.781825:0:6685:0:(import.c:65:import_set_state_nolock()) ffff931a4ae3d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790763.781946:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2345:x1874634236533248:12345-192.168.201.25@tcp:8:lhsmtool_posix.0 Request processed in 488us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790763.781954:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:3.0:1787790763.783600:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790763.786396:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236533376 00000100:00100000:2.0:1787790763.786411:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236533376 00000100:00100000:2.0:1787790763.786480:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:2.0:1787790763.786490:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53f06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:0:x1874634236533376:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787790763.786820:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787790763.809633:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1787790763.809650:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3e6e059d-f39a-42a8-9e93-fd30a950cc49 00000100:00100000:3.0:1787790763.809897:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53f06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:0:x1874634236533376:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 23401us (26298us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787790763.809910:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:3.0:1787790763.812477:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790763.812785:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236533632 00000100:00100000:0.0:1787790763.812794:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236533632 00000100:00100000:0.0:1787790763.812840:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:0.0:1787790763.812850:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+55:10450:x1874634236533632:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787790763.813132:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+56:10450:x1874634236533632:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 282us (663us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787790763.813141:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:0.0:1787790763.818221:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790763.818427:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236533888 00000100:00100000:1.0:1787790763.818438:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236533888 00000100:00100000:1.0:1787790763.818554:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 77 00000100:00100000:1.0:1787790763.818565:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+56:10450:x1874634236533888:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787790763.818708:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+56:10450:x1874634236533888:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 144us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790763.818716:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 77 00000100:00100000:0.0:1787790763.825171:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790763.825261:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236534016 00000100:00100000:3.0:1787790763.825270:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236534016 00000100:00100000:3.0:1787790763.825319:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00100000:3.0:1787790763.825330:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+56:10450:x1874634236534016:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787790763.825370:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790763.825392:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa97747f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb40 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.825469:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774800 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.825480:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774800 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.825489:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774800 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790763.825520:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787790763.825535:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774800 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.825554:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa97747f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb40 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.825566:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774800 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb40 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.825571:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff931a541ad700) 00010000:00010000:3.0:1787790763.825573:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787790763.825576:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153200, rc 0) 00000100:00100000:3.0:1787790763.825633:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+57:10450:x1874634236534016:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 304us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790763.825639:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00100000:3.0:1787790763.828067:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790763.828203:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236534144 00000100:00100000:0.0:1787790763.828213:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236534144 00000100:00100000:0.0:1787790763.828273:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:0.0:1787790763.828283:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2348:x1874634236534144:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787790763.828302:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790763.828318:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cdfd6bd/0x70647b5fa9774807 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb47 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787790763.828350:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f85ab, blocks: 0x1 00010000:00010000:0.0:1787790763.828366:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=298s v=(0 0) 00010000:00010000:0.0:1787790763.828379:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790763.828388:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cdfd6bd/0x70647b5fa9774807 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb47 expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.828402:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cdfd6bd/0x70647b5fa9774807 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb47 expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.828411:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a40030a00, rc 0) 00000100:00100000:0.0:1787790763.828462:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2348:x1874634236534144:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 182us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790763.828467:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:2.0:1787790763.832491:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790763.834287:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236534400 00000100:00100000:1.0:1787790763.834299:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236534400 00000100:00100000:1.0:1787790763.834360:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:1.0:1787790763.834371:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+57:10450:x1874634236534400:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787790763.834549:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+57:10450:x1874634236534400:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 179us (2067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790763.834558:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:1.0:1787790763.838577:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790763.838683:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236534528 00000100:00100000:2.0:1787790763.838692:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236534528 00000100:00100000:0.0:1787790763.839093:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:0.0:1787790763.839104:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:10450:x1874634236534528:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787790763.839121:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790763.839138:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4be1378/0x70647b5fa977480e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb4e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.839181:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cdfd6bd/0x70647b5fa9774807 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb47 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.839190:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790763.839195:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790763.839200:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4be1378/0x70647b5fa977480e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb4e expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.839233:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005cdfd6bd/0x70647b5fa9774807 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb47 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.839260:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005cdfd6bd/0x70647b5fa9774807 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb47 expref: 7 pid: 6685 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790763.839274:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db0da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6683:1874634253332480:192.168.201.25@tcp:104: 00000100:00100000:0.0:1787790763.839376:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7c296b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787790763.844301:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db0da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6683:1874634253332480:192.168.201.25@tcp:104: 00010000:00010000:1.0:1787790763.844351:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c4be1378/0x70647b5fa977480e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb4e expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.844374:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a40031400, rc 0) 00000100:00100000:1.0:1787790763.844439:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:10450:x1874634236534528:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 5337us (5871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790763.844449:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:0.0:1787790763.844458:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790763.845633:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236534656 00000100:00100000:3.0:1787790763.845641:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236534656 00010000:00010000:3.0:1787790763.845679:0:11653:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005cdfd6bd/0x70647b5fa9774807 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb47 expref: 7 pid: 6685 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790763.845708:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:3.0:1787790763.845744:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a493cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2349:x1874634236534656:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790763.845759:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790763.845781:0:11653:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005cdfd6bd/0x70647b5fa9774807 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb47 expref: 7 pid: 6685 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.845791:0:11653:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005cdfd6bd/0x70647b5fa9774807 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb47 expref: 7 pid: 6685 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.845813:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cdfd6bd/0x70647b5fa9774807 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb47 expref: 7 pid: 6685 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.845828:0:11653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790763.845831:0:11653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790763.845837:0:11653:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4be1378/0x70647b5fa977480e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb4e expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.845860:0:11653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4be1378/0x70647b5fa977480e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb4e expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790763.845912:0:11653:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c4be1378/0x70647b5fa977480e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb4e expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790763.845922:0:11653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d8eda40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11653:1874634253332608:192.168.201.25@tcp:105: 00000100:00100000:3.0:1787790763.845986:0:11653:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a42f60240 going to sleep for 11 seconds 00000100:00100000:3.0:1787790763.851763:0:11653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d8eda40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11653:1874634253332608:192.168.201.25@tcp:105: 00010000:00010000:3.0:1787790763.851788:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790763.851840:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a493cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2349:x1874634236534656:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 6119us (7382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790763.851852:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:1.0:1787790763.852820:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790763.852880:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236534784 00000100:00100000:0.0:1787790763.852887:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236534784 00002000:00100000:0.0:1787790763.852932:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff931a7be2a940 x1874634236534784/t0(0) o4->3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp:604/0 lens 504/0 e 0 to 0 dl 1787790774 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787790763.852942:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a7be2a940 with x1874634236534784 ext(0->8) 00002000:00010000:0.0:1787790763.852946:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff931a7be2a940 00000100:00100000:0.0:1787790763.852980:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:0.0:1787790763.852989:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2349:x1874634236534784:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787790763.855018:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2349:x1874634236534784:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 Request processed in 2022us (2193us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787790763.855030:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00002000:00100000:0.0:1787790763.855040:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff931a7be2a940 x1874634236534784/t4294967302(0) o4->3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp:604/0 lens 504/448 e 0 to 0 dl 1787790774 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787790763.855050:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a7be2a940 with x1874634236534784 ext(0->8) 00002000:00010000:0.0:1787790763.855055:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff931a7be2a940 00000100:00100000:2.0:1787790763.856975:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790763.857068:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236534912 00000100:00100000:0.0:1787790763.857087:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236534912 00000100:00100000:0.0:1787790763.857177:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 80 00000100:00100000:0.0:1787790763.857186:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+57:10450:x1874634236534912:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787790763.898271:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1787790763.900487:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:1.0:1787790763.900968:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1787790763.901200:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff931a44cd4000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787790763.901206:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff931a489a1600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff931a44cd49c0 00000020:00080000:1.0:1787790763.901209:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff931a489a1000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff931a4bcbf000 00000100:00100000:1.0:1787790763.902686:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253332736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787790763.902771:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790763.902823:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253332864:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787790763.902846:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790763.902877:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253332736 00000100:00100000:1.0:1787790763.902891:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253332736 00000100:00100000:1.0:1787790763.902938:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253332864 00000100:00100000:1.0:1787790763.902941:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253332864 00000100:00100000:1.0:1787790763.902960:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787790763.902968:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253332736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787790763.903122:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787790763.903126:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787790763 00002000:00010000:1.0:1787790763.903128:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787790763.903152:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787790763 -> 1787790763 00002000:00010000:1.0:1787790763.903154:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787790763.903199:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1874634253332736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 231us (429us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787790763.903207:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787790763.903223:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787790763.903229:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be29e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1874634253332864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787790763.903243:0:6684:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1787790763.903268:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8f85a9, atime: 0x6a8f85aa, ctime: 0x6a8f85a9, blocks: 0x1 00010000:00010000:1.0:1787790763.903275:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007387854d/0x70647b5fa9774815 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.903289:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=298s v=(0 0) 00010000:00010000:1.0:1787790763.903293:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790763.903299:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007387854d/0x70647b5fa9774815 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787790763.903302:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff931a7be2b0c0/2, rc 0, transno 4294967303 00000100:00100000:3.0:1787790763.903308:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253332736:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1787790763.903314:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007387854d/0x70647b5fa9774815 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790763.903473:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+13:10450:x1874634236534912:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 Request processed in 46284us (46501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790763.903482:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 80 00010000:00010000:1.0:1787790763.904401:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007387854d/0x70647b5fa9774815 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.904410:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007387854d/0x70647b5fa9774815 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.904429:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787790763.905017:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be29e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3320:x1874634253332864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1786us (2167us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787790763.905027:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787790763.905058:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787790763.905073:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790763.905079:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007387854d/0x70647b5fa9774815 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.905088:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704000 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790763.905093:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007387854d/0x70647b5fa9774815 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.905102:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007387854d/0x70647b5fa9774815 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.905120:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007387854d/0x70647b5fa9774815 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.905160:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007387854d/0x70647b5fa9774815 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.905179:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790763.905181:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790763.905182:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787790763.905214:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff931a7be283c0/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787790763.905220:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253332864:0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1787790763.905536:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1787790763.905621:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787790763.914619:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790763.914706:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236535040 00000100:00100000:1.0:1787790763.914716:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236535040 00000100:00100000:1.0:1787790763.914784:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 30 00000100:00100000:1.0:1787790763.914794:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2347:x1874634236535040:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787790763.986138:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1787790763.986170:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1787790763.986490:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2347:x1874634236535040:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 Request processed in 71692us (71876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790763.986502:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 30 00000100:00100000:3.0:1787790763.989823:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790763.989928:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236535296 00000100:00100000:0.0:1787790763.989938:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236535296 00000100:00100000:0.0:1787790763.989994:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 81 00000100:00100000:0.0:1787790763.990005:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+13:10450:x1874634236535296:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787790763.990060:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790763.990088:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774800 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb40 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.990107:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff931a541ad700) 00010000:00010000:0.0:1787790763.990112:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787790763.990154:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa977481c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.990168:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa977481c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790763.990178:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa977481c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790763.990413:0:7920:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5f79fad reply state 0000000063396837 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa977481c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790763.990434:0:7920:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787790763.990522:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+14:10450:x1874634236535296:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 519us (709us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787790763.990530:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 81 00010000:00010000:1.0:1787790763.996473:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa977481c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.996490:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa977481c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.996498:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa977481c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.996504:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790763.996509:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa977481c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.996530:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa977481c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.996546:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff931a541ad700) 00010000:00010000:1.0:1787790763.996550:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790763.996555:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa977481c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790763.996561:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa977481c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790763.998538:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790763.998623:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236535424 00000100:00100000:1.0:1787790763.998633:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236535424 00000100:00100000:1.0:1787790763.998691:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:1.0:1787790763.998701:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2349:x1874634236535424:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787790763.998986:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787790763.998990:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787790763 -> 1787790763 00002000:00010000:1.0:1787790763.998993:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787790762 00002000:00010000:1.0:1787790763.998995:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787790763 -> 1787790763 00002000:00010000:1.0:1787790763.998998:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787790763.999051:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2349:x1874634236535424:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 351us (523us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787790763.999059:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:0.0:1787790764.006139:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790764.016289:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236535680 00000100:00100000:3.0:1787790764.016300:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236535680 00000100:00100000:1.0:1787790764.022838:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 82 00000100:00100000:1.0:1787790764.022853:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+13:10450:x1874634236535680:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787790764.022929:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774823 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.022955:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa97747dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb32 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.022964:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774823 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.022999:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa97747dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb32 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.023014:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa97747dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb32 expref: 13 pid: 5847 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790764.023031:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be29680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874634253332992:192.168.201.25@tcp:104: 00000100:00100000:1.0:1787790764.023125:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d815600 going to sleep for 11 seconds 00000100:00100000:1.0:1787790764.030008:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be29680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874634253332992:192.168.201.25@tcp:104: 00010000:00010000:1.0:1787790764.030041:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774823 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790764.034566:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790764.034654:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236535808 00000100:00100000:1.0:1787790764.034665:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236535808 00010000:00010000:1.0:1787790764.034712:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa97747dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb32 expref: 14 pid: 5847 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790764.034781:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:1.0:1787790764.034793:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+14:2348:x1874634236535808:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790764.034812:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790764.034833:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa97747dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb32 expref: 14 pid: 5847 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.034848:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa97747dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb32 expref: 14 pid: 5847 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.034875:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa97747dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb32 expref: 14 pid: 5847 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.034891:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff931a541ad700) 00010000:00010000:1.0:1787790764.034898:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774823 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.034908:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.034916:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774823 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.034952:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790764.035001:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+13:2348:x1874634236535808:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 211us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790764.035009:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 43 00010000:00010000:3.0:1787790764.035114:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.035123:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.035160:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.035371:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774823 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.035385:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774823 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.035391:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790764.035396:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774823 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.035404:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774823 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.035413:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff931a541ad700) 00010000:00010000:3.0:1787790764.035416:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787790764.035420:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774823 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.035426:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774823 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790764.035466:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+12:10450:x1874634236535680:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 Request processed in 12617us (29333us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787790764.035475:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 82 00000100:00100000:3.0:1787790764.045046:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790764.045181:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236535936 00000100:00100000:0.0:1787790764.045192:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236535936 00000100:00100000:0.0:1787790764.045248:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:0.0:1787790764.045259:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2346:x1874634236535936:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787790764.045305:0:8297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001afbfbf9/0x70647b5fa977482a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.045337:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4be1378/0x70647b5fa977480e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb4e expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.045347:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790764.045351:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787790764.045356:0:8297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001afbfbf9/0x70647b5fa977482a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.045394:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4be1378/0x70647b5fa977480e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb4e expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.045408:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4be1378/0x70647b5fa977480e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb4e expref: 7 pid: 6683 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790764.045438:0:8297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db0f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8297:1874634253333120:192.168.201.25@tcp:104: 00000100:00100000:0.0:1787790764.045524:0:8297:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4cbf7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790764.050960:0:8297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db0f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8297:1874634253333120:192.168.201.25@tcp:104: 00010000:00010000:3.0:1787790764.050992:0:8297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001afbfbf9/0x70647b5fa977482a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790764.054417:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790764.055085:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236536064 00000100:00100000:1.0:1787790764.055096:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236536064 00010000:00010000:1.0:1787790764.055134:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4be1378/0x70647b5fa977480e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb4e expref: 8 pid: 6683 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790764.055214:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:1.0:1787790764.055223:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2349:x1874634236536064:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790764.055248:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790764.055270:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c4be1378/0x70647b5fa977480e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb4e expref: 8 pid: 6683 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.055284:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4be1378/0x70647b5fa977480e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb4e expref: 8 pid: 6683 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.055306:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4be1378/0x70647b5fa977480e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb4e expref: 8 pid: 6683 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.055391:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787790764.055396:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787790764.055402:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001afbfbf9/0x70647b5fa977482a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.055413:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001afbfbf9/0x70647b5fa977482a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.055491:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790764.055552:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2349:x1874634236536064:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 329us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790764.055560:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 44 00010000:00010000:2.0:1787790764.055680:0:8297:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001afbfbf9/0x70647b5fa977482a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.055691:0:8297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001afbfbf9/0x70647b5fa977482a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.055836:0:8297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001afbfbf9/0x70647b5fa977482a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.055846:0:8297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001afbfbf9/0x70647b5fa977482a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.055855:0:8297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001afbfbf9/0x70647b5fa977482a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.055862:0:8297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030600 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:2.0:1787790764.055866:0:8297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001afbfbf9/0x70647b5fa977482a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.055874:0:8297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001afbfbf9/0x70647b5fa977482a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.055902:0:8297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001afbfbf9/0x70647b5fa977482a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.055912:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001afbfbf9/0x70647b5fa977482a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790764.055960:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2346:x1874634236535936:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 Request processed in 10703us (10923us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790764.055967:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:0.0:1787790764.069957:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790764.070033:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236536320 00000100:00100000:2.0:1787790764.070042:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236536320 00000100:00100000:2.0:1787790764.070099:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 83 00000100:00100000:2.0:1787790764.070108:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+12:10450:x1874634236536320:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787790764.070198:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774831 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.070216:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.070229:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.070456:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774838 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.070468:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97747eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb39 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.070490:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774838 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.070521:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97747eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb39 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.070534:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97747eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb39 expref: 13 pid: 5847 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790764.070548:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccf840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1874634253333248:192.168.201.25@tcp:104: 00000100:00100000:2.0:1787790764.070631:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787790764.079860:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790764.080189:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236536448 00000100:00100000:3.0:1787790764.080199:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236536448 00010000:00010000:3.0:1787790764.080251:0:11653:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97747eb lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb39 expref: 14 pid: 5847 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790764.080365:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:3.0:1787790764.080377:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+14:2348:x1874634236536448:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790764.080394:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790764.080402:0:11653:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97747eb lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb39 expref: 14 pid: 5847 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.080417:0:11653:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97747eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb39 expref: 14 pid: 5847 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.080441:0:11653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff931a541ad700) 00010000:00010000:3.0:1787790764.080447:0:11653:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774838 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.080457:0:11653:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774838 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.080465:0:11653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774838 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.080486:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790764.080547:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+14:2348:x1874634236536448:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 173us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790764.080555:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 45 00010000:00010000:1.0:1787790764.080794:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97747eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb39 expref: 13 pid: 5847 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790764.080809:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccf840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1874634253333248:192.168.201.25@tcp:104: 00010000:00010000:1.0:1787790764.080839:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774838 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.080849:0:7920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774838 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.080855:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774838 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787790764.081050:0:7920:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1787790764.081217:0:7920:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1787790764.081909:0:7920:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1787790764.082019:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be29680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7920:1874634253333376:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787790764.082081:0:7920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790764.082109:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a42f94780 going to sleep for 11 seconds 00000100:00100000:0.0:1787790764.082138:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253333376 00000100:00100000:0.0:1787790764.082154:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253333376 00000100:00100000:0.0:1787790764.082205:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787790764.082213:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7920:x1874634253333376:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787790764.082287:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7920:x1874634253333376:12345-0@lo:1000:mdt00_003.0 Request processed in 73us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790764.082302:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787790764.082335:0:7920:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1787790764.082340:0:7920:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff931a7be2b0c0, transno 4294967303 00000100:00100000:0.0:1787790764.082356:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be29680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7920:1874634253333376:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787790764.088835:0:7920:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1787790764.088952:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db0c780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7920:1874634253333504:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787790764.089025:0:7920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790764.089125:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d815600 going to sleep for 11 seconds 00000100:00100000:3.0:1787790764.095049:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253333504 00000100:00100000:3.0:1787790764.095059:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253333504 00000100:00100000:1.0:1787790764.095305:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787790764.095316:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7920:x1874634253333504:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787790764.095619:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7920:x1874634253333504:12345-0@lo:1000:mdt00_003.0 Request processed in 305us (6592us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787790764.095627:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787790764.096738:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db0c780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7920:1874634253333504:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787790764.096790:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774838 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.096800:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774838 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.096808:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774838 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.096813:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790764.096818:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774838 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.096825:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774838 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.096850:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff931a541ad700) 00010000:00010000:3.0:1787790764.096853:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787790764.096858:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774838 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.096864:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774838 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.096896:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774766 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.096902:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774766 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.096906:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774766 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.096919:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790764.096922:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774766 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.096927:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774766 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.096935:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a488be800) 00010000:00010000:3.0:1787790764.096937:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787790764.096940:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774766 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.096945:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774766 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.096965:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977483f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.096978:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774782 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb1d expref: 16 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.096986:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977483f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.097012:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774782 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb1d expref: 16 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.097026:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774782 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb1d expref: 16 pid: 7920 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790764.097050:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d8ef840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1874634253333760:192.168.201.25@tcp:104: 00000100:00100000:3.0:1787790764.097120:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a478f1540 going to sleep for 11 seconds 00000100:00100000:3.0:1787790764.097908:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790764.097928:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253333632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790764.097980:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790764.098504:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253333632 00000100:00100000:1.0:1787790764.098513:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253333632 00000100:00100000:1.0:1787790764.098557:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787790764.098566:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1874634253333632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787790764.098589:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1787790764.098968:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1874634253333632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 402us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790764.098977:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787790764.099075:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253333632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790764.100319:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d8ef840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1874634253333760:192.168.201.25@tcp:104: 00010000:00010000:3.0:1787790764.100342:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977483f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790764.105207:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790764.108402:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236536576 00000100:00100000:1.0:1787790764.108417:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236536576 00010000:00010000:1.0:1787790764.108473:0:8498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774782 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb1d expref: 17 pid: 7920 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790764.111492:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:1.0:1787790764.111511:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+17:2348:x1874634236536576:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790764.111533:0:8498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790764.111544:0:8498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774782 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb1d expref: 17 pid: 7920 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.111564:0:8498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774782 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb1d expref: 17 pid: 7920 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.111585:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774782 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb1d expref: 17 pid: 7920 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.111598:0:8498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a488be800) 00010000:00010000:1.0:1787790764.111603:0:8498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977483f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.111612:0:8498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977483f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.111620:0:8498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977483f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.111651:0:8498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787790764.111687:0:7920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977483f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.111694:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977483f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790764.111713:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+16:2348:x1874634236536576:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 210us (6517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790764.111746:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 46 00010000:00010000:3.0:1787790764.112150:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977483f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.112157:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977483f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.112164:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977483f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.112169:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790764.112173:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977483f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.112191:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977483f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.112201:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a488be800) 00010000:00010000:3.0:1787790764.112204:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790764.112208:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977483f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.112214:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977483f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.112224:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.112230:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774831 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.112235:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774831 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.112240:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654fe00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790764.112243:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774831 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.112248:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774831 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.112255:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a488be800) 00010000:00010000:3.0:1787790764.112257:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787790764.112260:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774831 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.112275:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774831 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790764.115440:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+15:10450:x1874634236536320:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 45320us (45480us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1787790764.115454:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 83 00000020:00080000:0.0:1787790764.115459:0:7920:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787790764.115528:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787790764.115533:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787790764.115561:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787790764.115566:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787790764.123109:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790764.123170:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236536832 00000100:00100000:3.0:1787790764.123180:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236536832 00000100:00100000:3.0:1787790764.123240:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:3.0:1787790764.123250:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+15:10450:x1874634236536832:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787790764.124007:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787790764.124115:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1787790764.124173:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774846 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.124190:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774846 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.124203:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774846 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.124212:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774846 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.124219:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774846 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.124225:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774846 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.124249:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787790764.124350:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+17:10450:x1874634236536832:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 1099us (1248us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787790764.124358:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00000020:00080000:3.0:1787790764.124363:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787790764.124437:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790764.124445:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774846 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.124453:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152c00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:2.0:1787790764.124457:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774846 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.124465:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774846 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.124477:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff931a541ad700) 00010000:00010000:2.0:1787790764.124480:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787790764.124485:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774846 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.124499:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774846 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.124516:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790764.124517:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790764.124519:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787790764.320145:0:11991:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787790764.320155:0:11991:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787790764.320193:0:11991:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787790764.320198:0:11991:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787790764.465652:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790764.465862:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236537088 00000100:00100000:0.0:1787790764.465873:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236537088 00000100:00100000:0.0:1787790764.465939:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 84 00000100:00100000:0.0:1787790764.465949:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+17:10460:x1874634236537088:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1787790764.465973:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790764.465993:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa977484d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb55 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.466262:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa9774854 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.466276:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa9774854 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.466287:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa9774854 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790764.466298:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787790764.466485:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa977484d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb55 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.466504:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa9774854 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb55 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.466511:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:0.0:1787790764.466514:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787790764.466518:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a40030600, rc 0) 00000100:00100000:0.0:1787790764.466586:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+19:10460:x1874634236537088:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 638us (945us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1787790764.466605:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 84 00000100:00100000:0.0:1787790764.476752:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790764.476819:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236537216 00000100:00100000:3.0:1787790764.476827:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236537216 00000100:00100000:3.0:1787790764.476872:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 85 00000100:00100000:3.0:1787790764.476879:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+19:10460:x1874634236537216:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:3.0:1787790764.476942:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774862 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.476958:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774862 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.476966:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774862 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.476976:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774869 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.476981:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.476985:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.478643:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774870 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.478659:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.478669:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787790764.481102:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.481131:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774862 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.481148:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774862 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.481157:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774862 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.481163:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790764.481167:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774862 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.481176:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774862 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.481194:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:2.0:1787790764.481197:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790764.481202:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774862 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.481209:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774862 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.481232:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.481239:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774869 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.481245:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774869 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.481251:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790764.481254:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774869 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.481261:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774869 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.481269:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff931a541ada00) 00010000:00010000:2.0:1787790764.481272:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790764.481275:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774869 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.481281:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774869 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.481297:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.481303:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774870 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.481309:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774870 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.481320:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790764.481323:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774870 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.481329:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774870 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.481336:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a541ad800) 00010000:00010000:2.0:1787790764.481339:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790764.481341:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774870 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.481347:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774870 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790764.483204:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+19:10460:x1874634236537216:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 6315us (6449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790764.483218:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 85 00000100:00100000:0.0:1787790764.544204:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790764.544346:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236537472 00000100:00100000:0.0:1787790764.544356:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236537472 00000100:00100000:0.0:1787790764.544415:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 86 00000100:00100000:0.0:1787790764.544425:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+19:10463:x1874634236537472:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1787790764.544446:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790764.544473:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774877 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb5c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.544550:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa977487e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.544565:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa977487e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.544577:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa977487e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.544594:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774885 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.544602:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.544609:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.544979:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977488c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.544995:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977488c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.545003:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977488c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790764.545014:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787790764.545109:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa977487e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.545117:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa977487e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.545124:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa977487e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.545131:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40031400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790764.545149:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa977487e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.545157:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa977487e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.545170:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:0.0:1787790764.545173:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790764.545178:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa977487e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.545185:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa977487e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.545198:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.545213:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774885 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.545219:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774885 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.545225:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790764.545228:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774885 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.545236:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774885 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.545244:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff931a49c31900) 00010000:00010000:0.0:1787790764.545246:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790764.545249:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774885 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.545256:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774885 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.545304:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774877 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb5c expref: 22 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.545318:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977488c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb5c expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.545326:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a49c31f00) 00010000:00010000:0.0:1787790764.545328:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790764.545338:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41478800, rc 0) 00000100:00100000:0.0:1787790764.545396:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:10463:x1874634236537472:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 973us (1209us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787790764.545404:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 86 00000100:00100000:0.0:1787790764.552434:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790764.552473:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236537600 00000100:00100000:0.0:1787790764.552483:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236537600 00000100:00100000:0.0:1787790764.552540:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 87 00000100:00100000:0.0:1787790764.552553:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:10463:x1874634236537600:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:0.0:1787790764.552619:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa977489a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.552636:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa977489a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.552649:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa977489a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.552674:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa977489a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.552682:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa977489a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.552689:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa977489a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.553839:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790764.553845:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa977489a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.553866:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa977489a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.553880:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a49c31f00) 00010000:00010000:0.0:1787790764.553883:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787790764.553887:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa977489a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.553894:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa977489a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790764.553979:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:10463:x1874634236537600:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 1427us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790764.553988:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 87 00000100:00100000:0.0:1787790764.556930:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790764.557032:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236537856 00000100:00100000:1.0:1787790764.557042:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236537856 00000100:00100000:1.0:1787790764.557100:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:1.0:1787790764.557111:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4a6bb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:10463:x1874634236537856:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:1.0:1787790764.557795:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4a6bb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+22:10463:x1874634236537856:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 682us (874us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787790764.557806:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:3.0:1787790764.602186:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790764.602326:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236538112 00000100:00100000:0.0:1787790764.602336:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236538112 00000100:00100000:0.0:1787790764.602397:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 88 00000100:00100000:0.0:1787790764.602407:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+22:9993:x1874634236538112:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:0.0:1787790764.602432:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790764.602451:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97748a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb63 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.602549:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97748a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.602566:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977488c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb5c expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.602599:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97748a8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.602633:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977488c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb5c expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.602647:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977488c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb5c expref: 23 pid: 5847 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790764.602659:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8119b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874634253333888:192.168.201.25@tcp:104: 00000100:00100000:1.0:1787790764.602840:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82600 going to sleep for 11 seconds 00000100:00100000:1.0:1787790764.608546:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8119b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874634253333888:192.168.201.25@tcp:104: 00010000:00010000:1.0:1787790764.608580:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97748a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790764.614200:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790764.614403:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236538240 00000100:00100000:1.0:1787790764.614413:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236538240 00010000:00010000:1.0:1787790764.614456:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977488c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb5c expref: 24 pid: 5847 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790764.614505:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:1.0:1787790764.614515:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+24:2349:x1874634236538240:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790764.614532:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790764.614539:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977488c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb5c expref: 24 pid: 5847 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.614554:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977488c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb5c expref: 24 pid: 5847 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.614592:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977488c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb5c expref: 24 pid: 5847 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.614610:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a49c31f00) 00010000:00010000:1.0:1787790764.614615:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97748a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.614625:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97748a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.614632:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97748a8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.614671:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787790764.614824:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97748a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.614834:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97748a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790764.614845:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:2349:x1874634236538240:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 329us (652us total) trans 0 rc 0/0 00000004:00200000:0.0:1787790764.614853:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00000100:00100000:1.0:1787790764.614854:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 47 00010000:00010000:1.0:1787790764.615265:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97748a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb63 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.615282:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97748a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb63 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.615290:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a49c31f00) 00010000:00010000:1.0:1787790764.615293:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787790764.615295:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41479800, rc 0) 00000100:00100000:1.0:1787790764.615334:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:9993:x1874634236538112:12345-192.168.201.25@tcp:101:bash.0 Request processed in 12928us (13158us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787790764.615351:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 88 00000100:00100000:3.0:1787790764.630220:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790764.630296:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236538496 00000100:00100000:0.0:1787790764.630306:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236538496 00000100:00100000:0.0:1787790764.630413:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 89 00000100:00100000:0.0:1787790764.630424:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:9993:x1874634236538496:12345-192.168.201.25@tcp:36:bash.0 00010000:00010000:0.0:1787790764.630777:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97748b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.630794:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97748b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.630805:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97748b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787790764.630857:0:7920:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1787790764.630877:0:7920:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b72e56b9 reply state 000000009c4db895 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97748b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790764.630885:0:7920:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787790764.630923:0:7920:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1787790764.631019:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+27:9993:x1874634236538496:12345-192.168.201.25@tcp:36:bash.0 Request processed in 597us (808us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1787790764.631036:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 89 00000020:00080000:0.0:1787790764.631041:0:7920:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787790764.634426:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97748b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.634441:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97748b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.634446:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97748b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.634451:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790764.634455:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97748b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.634460:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97748b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790764.634469:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00010000:00010000:3.0:1787790764.634475:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a49c31f00) 00010000:00010000:3.0:1787790764.634478:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790764.634495:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97748b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.634500:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97748b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790764.634562:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236538624 00000100:00100000:1.0:1787790764.634569:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236538624 00000100:00100000:1.0:1787790764.634613:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 90 00000100:00100000:1.0:1787790764.634620:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53cce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+26:9993:x1874634236538624:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1787790764.634639:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790764.634651:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa97748bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb6a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.634695:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa97748bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb6a expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.634704:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa97748bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb6a expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.634716:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a49c31f00) 00010000:00010000:1.0:1787790764.634718:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787790764.634719:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45704c00, rc 0) 00000100:00100000:1.0:1787790764.634796:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53cce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+27:9993:x1874634236538624:12345-192.168.201.25@tcp:101:bash.0 Request processed in 177us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790764.634802:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 90 00000100:00100000:1.0:1787790764.637693:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790764.637844:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236538752 00000100:00100000:2.0:1787790764.637852:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236538752 00000100:00100000:2.0:1787790764.637919:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:2.0:1787790764.637928:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be28780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:9993:x1874634236538752:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:2.0:1787790764.637949:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790764.637970:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002559e762/0x70647b5fa97748c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb71 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787790764.637992:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f85ab, atime: 0x6a8f85aa, ctime: 0x6a8f85ab, blocks: 0xb 00010000:00010000:2.0:1787790764.638033:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=299s v=(0 0) 00010000:00010000:2.0:1787790764.638038:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790764.638046:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002559e762/0x70647b5fa97748c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb71 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.638063:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002559e762/0x70647b5fa97748c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb71 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.638076:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654fe00, rc 0) 00000100:00100000:2.0:1787790764.638141:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be28780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:9993:x1874634236538752:12345-192.168.201.25@tcp:101:bash.0 Request processed in 203us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790764.638148:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:3.0:1787790764.641204:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790764.641299:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236538880 00000100:00100000:2.0:1787790764.641310:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236538880 00002000:00010000:2.0:1787790764.641353:0:6689:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787790764.641358:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a7d8ec780 with x1874634236538880 ext(0->18446744073709551615) 00002000:00010000:2.0:1787790764.641371:0:6689:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff931a7d8ec780. 00000100:00100000:2.0:1787790764.641407:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:2.0:1787790764.641418:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2348:x1874634236538880:12345-192.168.201.25@tcp:10:bash.0 00002000:00010000:2.0:1787790764.641686:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787790764.641690:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787790763 -> 1787790764 00002000:00010000:2.0:1787790764.641692:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787790762 -> 1787790762 00002000:00010000:2.0:1787790764.641693:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787790763 -> 1787790764 00002000:00010000:2.0:1787790764.641695:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787790764.642361:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2348:x1874634236538880:12345-192.168.201.25@tcp:10:bash.0 Request processed in 943us (1164us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787790764.642388:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 1 00002000:00010000:2.0:1787790764.642393:0:6689:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787790764.642395:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a7d8ec780 with x1874634236538880 ext(0->18446744073709551615) 00002000:00010000:2.0:1787790764.642401:0:6689:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff931a7d8ec780. 00000100:00100000:0.0:1787790764.692631:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790764.692768:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236539008 00000100:00100000:3.0:1787790764.692787:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236539008 00000100:00100000:3.0:1787790764.692946:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 91 00000100:00100000:3.0:1787790764.692960:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a811983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+27:10477:x1874634236539008:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:3.0:1787790764.693061:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa97748cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.693083:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa97748cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.693108:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa97748cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.693923:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa97748d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.693939:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa97748d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.693948:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa97748d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.694818:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97748d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.694833:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97748d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.694991:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97748d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787790764.695054:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97748d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.695070:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa97748cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.695077:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa97748cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.695085:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa97748cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.695092:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790764.695097:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa97748cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.695429:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa97748cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.695446:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:3.0:1787790764.695450:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790764.695456:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa97748cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.695464:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa97748cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.695481:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa97748d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.695495:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa97748d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.695502:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa97748d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.695507:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790764.695511:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa97748d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.695518:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa97748d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.695526:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff931a541ad200) 00010000:00010000:3.0:1787790764.695529:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790764.695531:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa97748d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.695538:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa97748d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.695556:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97748d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.695576:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97748d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.695582:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97748d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.695588:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790764.695796:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97748d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.695806:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97748d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.695815:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a49c31f00) 00010000:00010000:3.0:1787790764.695818:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790764.695822:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97748d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.695828:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97748d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790764.696718:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a811983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+27:10477:x1874634236539008:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 3751us (4085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790764.696770:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 91 00000100:00100000:1.0:1787790764.759371:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790764.759523:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236539264 00000100:00100000:2.0:1787790764.759534:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236539264 00000100:00100000:2.0:1787790764.759594:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 92 00000100:00100000:2.0:1787790764.759604:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+27:10480:x1874634236539264:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1787790764.759635:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790764.759665:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97748e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb78 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.759763:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa97748e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.759778:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa97748e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.759788:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa97748e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.759801:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97748ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.759818:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97748ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.759826:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97748ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.760520:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa97748f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.760533:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa97748f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.760542:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa97748f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790764.760552:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787790764.760641:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa97748e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.760649:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa97748e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.760656:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa97748e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.760662:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790764.760667:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa97748e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.760674:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa97748e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.760685:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:2.0:1787790764.760688:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790764.760692:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa97748e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.760706:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa97748e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.760718:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97748ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.760773:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97748ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.760778:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97748ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.760783:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654e200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790764.760786:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97748ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.760791:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97748ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.760798:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff931a4b7e7000) 00010000:00010000:2.0:1787790764.760801:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790764.760803:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97748ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.761412:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa97748ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.761462:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97748e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb78 expref: 30 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.761477:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa97748f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb78 expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.761494:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a49c31f00) 00010000:00010000:2.0:1787790764.761496:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787790764.761498:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654f400, rc 0) 00000100:00100000:2.0:1787790764.761568:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+29:10480:x1874634236539264:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1965us (2207us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787790764.761577:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 92 00000100:00100000:0.0:1787790764.767222:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790764.767578:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236539392 00000100:00100000:2.0:1787790764.767588:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236539392 00000100:00100000:2.0:1787790764.767687:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 93 00000100:00100000:2.0:1787790764.767697:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81199a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+29:10480:x1874634236539392:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:2.0:1787790764.767790:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774903 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.767806:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97748a8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb63 expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.767815:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774903 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.767848:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97748a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb63 expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.767871:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97748a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb63 expref: 29 pid: 5847 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790764.767885:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1874634253334016:192.168.201.25@tcp:104: 00000100:00100000:2.0:1787790764.768151:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9c480 going to sleep for 11 seconds 00000100:00100000:0.0:1787790764.771707:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790764.771894:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236539648 00000100:00100000:3.0:1787790764.771903:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236539648 00000100:00100000:3.0:1787790764.771970:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:3.0:1787790764.771980:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81199e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+30:5583:x1874634236539648:12345-192.168.201.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787790764.772337:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81199e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+31:5583:x1874634236539648:12345-192.168.201.25@tcp:35:ldlm_bl.0 Request processed in 358us (641us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787790764.772353:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:2.0:1787790764.773424:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1874634253334016:192.168.201.25@tcp:104: 00010000:00010000:2.0:1787790764.773450:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774903 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790764.777507:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790764.777626:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236539776 00000100:00100000:0.0:1787790764.777635:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236539776 00010000:00010000:0.0:1787790764.777677:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97748a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb63 expref: 31 pid: 5847 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790764.777708:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:0.0:1787790764.777714:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+31:2349:x1874634236539776:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790764.777749:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790764.777755:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97748a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb63 expref: 31 pid: 5847 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.777765:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97748a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb63 expref: 31 pid: 5847 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.777795:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97748a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb63 expref: 31 pid: 5847 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.778207:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a49c31f00) 00010000:00010000:0.0:1787790764.778215:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774903 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.778225:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.778234:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774903 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790764.778317:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790764.778389:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+30:2349:x1874634236539776:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 672us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790764.778397:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 48 00010000:00010000:2.0:1787790764.778707:0:7920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.778716:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.779042:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.779099:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774903 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.779106:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774903 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.779186:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654ec00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790764.779191:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774903 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.779200:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774903 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.779214:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a49c31f00) 00010000:00010000:2.0:1787790764.779217:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787790764.779220:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774903 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.779241:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774903 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790764.779340:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81199a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+29:10480:x1874634236539392:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 11643us (12128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790764.779358:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 93 00000100:00100000:1.0:1787790764.783593:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790764.783931:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236540032 00000100:00100000:3.0:1787790764.783945:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236540032 00000100:00100000:3.0:1787790764.784057:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:3.0:1787790764.784070:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+29:10480:x1874634236540032:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1787790764.785074:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+30:10480:x1874634236540032:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 1000us (1490us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787790764.786116:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 23 00010000:00010000:1.0:1787790764.800529:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790764.877997:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790764.878102:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236540288 00000100:00100000:1.0:1787790764.878119:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236540288 00000100:00100000:1.0:1787790764.878284:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 94 00000100:00100000:1.0:1787790764.878298:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81199680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+30:10491:x1874634236540288:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:1.0:1787790764.878344:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790764.878372:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa977490a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb7f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.878474:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774911 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.878492:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774911 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.878507:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774911 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.878525:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa9774918 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.878533:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa9774918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.878539:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa9774918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.879036:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa977491f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.879047:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa977491f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.879068:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa977491f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790764.879081:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787790764.879218:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774911 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.879226:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774911 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.879233:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774911 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.879239:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790764.879243:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774911 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.879251:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774911 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.879265:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:1.0:1787790764.879268:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790764.879273:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774911 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.879280:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774911 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.879294:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa9774918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.879300:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa9774918 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.879325:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa9774918 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.879331:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790764.879334:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa9774918 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.879341:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa9774918 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.879349:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff931a488be900) 00010000:00010000:1.0:1787790764.879351:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790764.879354:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa9774918 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.879360:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa9774918 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.879422:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa977490a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb7f expref: 33 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.879439:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa977491f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb7f expref: 32 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.879445:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a49c31f00) 00010000:00010000:1.0:1787790764.879447:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787790764.879450:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45704e00, rc 0) 00000100:00100000:1.0:1787790764.879552:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81199680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+32:10491:x1874634236540288:12345-192.168.201.25@tcp:101:cat.0 Request processed in 1257us (1567us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787790764.879572:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 94 00000100:00100000:0.0:1787790764.887715:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790764.887823:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236540544 00000100:00100000:1.0:1787790764.887842:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236540544 00000100:00100000:1.0:1787790764.887947:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:1.0:1787790764.887962:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+32:10491:x1874634236540544:12345-192.168.201.25@tcp:35:cat.0 00000100:00100000:1.0:1787790764.888347:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+33:10491:x1874634236540544:12345-192.168.201.25@tcp:35:cat.0 Request processed in 388us (638us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787790764.888357:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:3.0:1787790764.911566:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790764.912048:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236540800 00000100:00100000:2.0:1787790764.912063:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236540800 00000100:00100000:2.0:1787790764.912185:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 95 00000100:00100000:2.0:1787790764.912198:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+33:10492:x1874634236540800:12345-192.168.201.25@tcp:36:rm.0 00010000:00010000:2.0:1787790764.912284:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787790764.912452:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa977491f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb7f expref: 33 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.912483:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa97748f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb78 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.912497:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa97748bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb6a expref: 31 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.912508:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a49c31f00) 00010000:00010000:2.0:1787790764.912522:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790764.912547:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa977492d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.912564:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa977492d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.912604:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa977492d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.912621:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774934 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.912628:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774934 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.912634:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774934 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.913585:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa977493b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.913952:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa977493b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.913963:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa977493b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787790764.915891:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1787790764.915910:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 299796185288ns, next at 300796180455ns, rc = 0 00010000:00010000:2.0:1787790764.916003:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774942 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.916021:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774942 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.916034:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774942 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.916058:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774942 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.916066:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774942 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.916074:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774942 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.916114:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787790764.916153:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa977493b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.916159:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa977493b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.916176:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa977493b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.916183:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790764.916188:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa977493b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.916197:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa977493b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.916213:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7f00) 00010000:00010000:2.0:1787790764.916216:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787790764.916221:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa977493b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.916238:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa977493b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.916263:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa977492d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.916269:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa977492d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.916275:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa977492d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.916281:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654ec00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790764.916284:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa977492d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.916290:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa977492d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.916300:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:2.0:1787790764.916302:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790764.916306:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa977492d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.916311:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa977492d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.916566:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790764.916575:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774942 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.916582:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f600 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790764.916586:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774942 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.916593:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774942 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.916602:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff931a4b7e7f00) 00010000:00010000:1.0:1787790764.916605:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787790764.916608:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774942 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.916614:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774942 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.916631:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790764.916633:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790764.916642:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1787790764.916966:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee0a81a9 reply state 000000003dd616ac transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774934 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790764.916978:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787790764.917295:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+32:10492:x1874634236540800:12345-192.168.201.25@tcp:36:rm.0 Request processed in 5093us (5738us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787790764.917307:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 95 00010000:00010000:1.0:1787790764.927659:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774934 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.927692:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774934 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.927703:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774934 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.927709:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654e200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790764.927715:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774934 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.927743:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774934 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.927765:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff931a4b7e7000) 00010000:00010000:1.0:1787790764.927769:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790764.927775:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774934 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.927782:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774934 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790764.980041:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790764.980202:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236541056 00000100:00100000:2.0:1787790764.980215:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236541056 00000100:00100000:2.0:1787790764.980300:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 96 00000100:00100000:2.0:1787790764.980322:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+31:10498:x1874634236541056:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:2.0:1787790764.980359:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790764.980388:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774949 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb86 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.980568:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774950 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.980587:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774950 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.980602:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774950 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.980619:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774957 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.980627:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774957 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.980633:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774957 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787790764.981366:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1787790764.981555:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa977495e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.981575:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa977495e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.981585:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa977495e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.981628:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774950 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.981635:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774950 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.981643:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774950 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.981649:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790764.981654:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774950 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.981662:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774950 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.981676:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:2.0:1787790764.981680:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790764.981685:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774950 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.981692:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774950 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787790764.981707:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086e26890 reply state 00000000a83a3e19 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774957 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790764.981775:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787790764.981815:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774949 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb86 expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.981832:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa977495e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb86 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790764.981841:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:2.0:1787790764.981843:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790764.981846:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654f000, rc 0) 00000100:00100000:2.0:1787790764.984297:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+34:10498:x1874634236541056:12345-192.168.201.25@tcp:101:bash.0 Request processed in 3970us (4253us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787790764.984326:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 96 00000100:00100000:0.0:1787790764.991929:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790764.992485:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236541184 00000100:00100000:1.0:1787790764.992499:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236541184 00000100:00100000:1.0:1787790764.992610:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 34 00000100:00100000:1.0:1787790764.992622:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2349:x1874634236541184:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1787790764.992647:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790764.992674:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068b3c95a/0x70647b5fa977496c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb8d expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787790764.992762:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790764.992791:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=299s v=(0 0) 00010000:00010000:1.0:1787790764.992797:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790764.992809:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068b3c95a/0x70647b5fa977496c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb8d expref: 8 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.992834:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000068b3c95a/0x70647b5fa977496c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb8d expref: 8 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790764.992850:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45705800, rc 0) 00000100:00100000:1.0:1787790764.992924:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2349:x1874634236541184:12345-192.168.201.25@tcp:101:bash.0 Request processed in 305us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790764.992932:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 34 00010000:00010000:3.0:1787790764.993218:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774957 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.993229:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774957 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.993237:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774957 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.993244:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790764.993249:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774957 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.993258:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774957 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.993274:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff931a4b7e7e00) 00010000:00010000:3.0:1787790764.993278:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790764.993283:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774957 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.993290:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774957 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787790764.996138:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790764.997337:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790764.997426:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236541312 00000100:00100000:3.0:1787790764.997439:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236541312 00000100:00100000:3.0:1787790764.997516:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:3.0:1787790764.997545:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:10498:x1874634236541312:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1787790764.997569:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790764.997602:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9774973 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb94 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.997643:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068b3c95a/0x70647b5fa977496c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb8d expref: 9 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.997654:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790764.997659:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790764.997665:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9774973 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb94 expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.997718:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068b3c95a/0x70647b5fa977496c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb8d expref: 9 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790764.997754:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068b3c95a/0x70647b5fa977496c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb8d expref: 9 pid: 6684 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790764.997769:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d8ecb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1874634253334144:192.168.201.25@tcp:104: 00000100:00100000:3.0:1787790764.998111:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a478f1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787790765.003408:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790765.003718:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d8ecb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1874634253334144:192.168.201.25@tcp:104: 00010000:00010000:3.0:1787790765.003803:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9774973 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb94 expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.003855:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82152200, rc 0) 00000100:00100000:3.0:1787790765.003924:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:10498:x1874634236541312:12345-192.168.201.25@tcp:101:bash.0 Request processed in 6381us (6601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790765.003935:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:1.0:1787790765.007306:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236541440 00000100:00100000:1.0:1787790765.007325:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236541440 00010000:00010000:1.0:1787790765.007387:0:8498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068b3c95a/0x70647b5fa977496c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb8d expref: 9 pid: 6684 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790765.007499:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:1.0:1787790765.007511:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a493ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:2349:x1874634236541440:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790765.007535:0:8498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790765.007562:0:8498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068b3c95a/0x70647b5fa977496c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb8d expref: 9 pid: 6684 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.007610:0:8498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068b3c95a/0x70647b5fa977496c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb8d expref: 9 pid: 6684 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.007638:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068b3c95a/0x70647b5fa977496c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb8d expref: 9 pid: 6684 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.007658:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790765.007663:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790765.007673:0:8498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9774973 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb94 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.007695:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9774973 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb94 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.007760:0:8498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9774973 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb94 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790765.007777:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be29680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8498:1874634253334272:192.168.201.25@tcp:105: 00000100:00100000:1.0:1787790765.007896:0:8498:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47a34840 going to sleep for 11 seconds 00000100:00100000:0.0:1787790765.014650:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790765.014776:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236541696 00000100:00100000:3.0:1787790765.014789:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236541696 00000100:00100000:3.0:1787790765.014867:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:3.0:1787790765.014878:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+33:10498:x1874634236541696:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:3.0:1787790765.015346:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+34:10498:x1874634236541696:12345-192.168.201.25@tcp:35:bash.0 Request processed in 469us (710us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787790765.015355:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00080000:0.0:1787790765.015770:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790765.016024:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be29680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8498:1874634253334272:192.168.201.25@tcp:105: 00010000:00010000:1.0:1787790765.016054:0:8498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790765.016088:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a493ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2349:x1874634236541440:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 8580us (12699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790765.016109:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:1.0:1787790765.120356:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d8ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253334400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790765.120465:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790765.120638:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253334528:0@lo:400:kworker.0 00000100:00100000:3.0:1787790765.120683:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790765.121240:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253334400 00000100:00100000:0.0:1787790765.121250:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253334400 00000100:00100000:0.0:1787790765.121345:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787790765.121357:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1874634253334400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787790765.121428:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787790765.121692:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787790765.122137:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253334656:0@lo:400:kworker.0 00000100:00100000:2.0:1787790765.122349:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790765.122395:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787790765.122401:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d80b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253334784:0@lo:400:kworker.0 00000100:00100000:2.0:1787790765.122427:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790765.122462:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d8083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253335040:0@lo:400:kworker.0 00000100:00100000:2.0:1787790765.122487:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790765.122506:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787790765.122511:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d80a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253334912:0@lo:400:kworker.0 00000100:00100000:2.0:1787790765.122537:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790765.122566:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253334656 00000100:00100000:2.0:1787790765.122572:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253334656 00000100:00100000:2.0:1787790765.122633:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253334784 00000100:00100000:2.0:1787790765.122638:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253334784 00000100:00080000:2.0:1787790765.122656:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790765.122682:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253335040 00000100:00100000:2.0:1787790765.122685:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253335040 00000100:00080000:2.0:1787790765.122705:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790765.122750:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787790765.122758:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931946935e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253334656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790765.122809:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931946935e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253334656:12345-0@lo:400:kworker.0 Request processed in 51us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790765.122816:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787790765.122860:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253334656:0@lo:400:kworker.0 00000100:00100000:2.0:1787790765.122894:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787790765.122901:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931946934f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253334784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790765.122937:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931946934f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253334784:12345-0@lo:400:kworker.0 Request processed in 37us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790765.122944:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787790765.122965:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d80b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253334784:0@lo:400:kworker.0 00000100:00100000:3.0:1787790765.123078:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787790765.123089:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9319469361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253335040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790765.123142:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9319469361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253335040:12345-0@lo:400:kworker.0 Request processed in 57us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790765.123149:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787790765.123372:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d8083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253335040:0@lo:400:kworker.0 00000100:00100000:2.0:1787790765.123424:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253334912 00000100:00100000:2.0:1787790765.123430:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253334912 00000100:00100000:2.0:1787790765.123476:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787790765.123483:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931946936580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1874634253334912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790765.123526:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931946936580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1874634253334912:12345-0@lo:400:kworker.0 Request processed in 44us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790765.123533:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787790765.123563:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253334528 00000100:00100000:2.0:1787790765.123568:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253334528 00000100:00100000:2.0:1787790765.123660:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787790765.123668:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45661850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253334528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790765.124108:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45661850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253334528:12345-0@lo:400:kworker.0 Request processed in 439us (3422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790765.124114:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787790765.124251:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d80a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253334912:0@lo:400:kworker.0 00000100:00100000:2.0:1787790765.124264:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253334528:0@lo:400:kworker.0 00000100:00080000:3.0:1787790765.124386:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790765.124626:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1874634253334400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3269us (4158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790765.124636:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787790765.124905:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d8ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253334400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790765.175712:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790765.175846:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236541824 00000100:00100000:3.0:1787790765.175860:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236541824 00000100:00100000:3.0:1787790765.175936:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 97 00000100:00100000:3.0:1787790765.175952:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+34:10514:x1874634236541824:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1787790765.176004:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790765.176036:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa977497a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eb9b expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.176118:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa9774981 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.176148:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa9774981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.176172:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa9774981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790765.176258:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787790765.176263:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787790765.176293:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa9774981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.176322:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa977497a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb9b expref: 36 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.176343:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa9774981 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb9b expref: 35 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.176352:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:3.0:1787790765.176355:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787790765.176358:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82152000, rc 0) 00000100:00100000:3.0:1787790765.176440:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+35:10514:x1874634236541824:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 495us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790765.176450:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 97 00000100:00100000:0.0:1787790765.182988:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790765.183266:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236542080 00000100:00100000:2.0:1787790765.183279:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236542080 00000100:00100000:2.0:1787790765.183414:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 98 00000100:00100000:2.0:1787790765.183428:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81198780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+35:10514:x1874634236542080:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1787790765.183456:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790765.183483:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774988 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eba2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.183631:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa977498f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.183651:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa977498f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.183665:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa977498f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790765.183677:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787790765.183897:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774988 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eba2 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.183940:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa977498f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eba2 expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.183951:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:2.0:1787790765.183954:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790765.183958:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654f200, rc 0) 00000100:00100000:2.0:1787790765.184026:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81198780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+37:10514:x1874634236542080:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 601us (1056us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787790765.184034:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 98 00000100:00100000:0.0:1787790765.188032:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790765.188543:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236542208 00000100:00100000:3.0:1787790765.188556:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236542208 00000100:00100000:3.0:1787790765.188658:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:3.0:1787790765.188669:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81198000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+37:2348:x1874634236542208:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790765.188700:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790765.188765:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa977498f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eba2 expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.188788:0:11653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:3.0:1787790765.188794:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790765.188859:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81198000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+36:2348:x1874634236542208:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 192us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790765.188868:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:0.0:1787790765.192488:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790765.192657:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236542464 00000100:00100000:3.0:1787790765.192668:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236542464 00000100:00100000:3.0:1787790765.194950:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 99 00000100:00100000:3.0:1787790765.194966:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+36:10514:x1874634236542464:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1787790765.194998:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790765.195026:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa977499d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eba9 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.195185:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa97749a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.195204:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa97749a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.195217:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa97749a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790765.195253:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787790765.195435:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa977499d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eba9 expref: 39 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.195456:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa97749a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eba9 expref: 38 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.195465:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:3.0:1787790765.195468:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787790765.195472:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82152800, rc 0) 00000100:00100000:3.0:1787790765.195554:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+38:10514:x1874634236542464:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 591us (3081us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1787790765.195563:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 99 00000100:00100000:0.0:1787790765.203140:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790765.203247:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236542592 00000100:00100000:1.0:1787790765.203414:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236542592 00000100:00100000:1.0:1787790765.203519:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:1.0:1787790765.203531:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81198b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2347:x1874634236542592:12345-192.168.201.25@tcp:1:lfs.0 00010000:00010000:1.0:1787790765.203594:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ead7b79/0x70647b5fa97749b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.203620:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9774973 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb94 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.203631:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787790765.203635:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787790765.203641:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ead7b79/0x70647b5fa97749b2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.203686:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9774973 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb94 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.203702:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9774973 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb94 expref: 8 pid: 6685 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790765.203720:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be29680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6683:1874634253335168:192.168.201.25@tcp:104: 00000100:00100000:1.0:1787790765.204026:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47a34b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787790765.207085:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790765.207381:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be29680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6683:1874634253335168:192.168.201.25@tcp:104: 00010000:00010000:2.0:1787790765.207416:0:6683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004ead7b79/0x70647b5fa97749b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790765.207598:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236542720 00000100:00100000:0.0:1787790765.207607:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236542720 00002000:00100000:0.0:1787790765.207669:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff931a7be28b40 x1874634236542720/t0(0) o4->3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp:606/0 lens 504/0 e 0 to 0 dl 1787790776 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787790765.207679:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a7be28b40 with x1874634236542720 ext(0->8) 00010000:00010000:0.0:1787790765.207687:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9774973 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb94 expref: 9 pid: 6685 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.207703:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9774973 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb94 expref: 9 pid: 6685 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787790765.207711:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff931a7be28b40 00000100:00100000:0.0:1787790765.207894:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:0.0:1787790765.207905:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:2349:x1874634236542720:12345-192.168.201.25@tcp:4:lfs.0 00000100:00100000:0.0:1787790765.208606:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+11:2349:x1874634236542720:12345-192.168.201.25@tcp:4:lfs.0 Request processed in 700us (1532us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787790765.208617:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 1 00002000:00100000:0.0:1787790765.208633:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff931a7be28b40 x1874634236542720/t4294967302(0) o4->3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp:606/0 lens 504/448 e 0 to 0 dl 1787790776 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787790765.208643:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a7be28b40 with x1874634236542720 ext(0->8) 00010000:00010000:0.0:1787790765.208651:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9774973 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb94 expref: 11 pid: 6685 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.208665:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9774973 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb94 expref: 11 pid: 6685 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787790765.208673:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff931a7be28b40 00000100:00100000:0.0:1787790765.211483:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790765.211591:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236542848 00000100:00100000:1.0:1787790765.211603:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236542848 00010000:00010000:1.0:1787790765.211656:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9774973 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb94 expref: 11 pid: 6685 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790765.211707:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:1.0:1787790765.211717:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81198f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+11:2347:x1874634236542848:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790765.211979:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787790765.212006:0:5832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787790765.212009:0:5832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787790765 00002000:00010000:1.0:1787790765.212012:0:5832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787790765 00002000:00010000:1.0:1787790765.212014:0:5832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787790765 00010000:00010000:1.0:1787790765.212021:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9774973 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb94 expref: 11 pid: 6685 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.212035:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9774973 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb94 expref: 11 pid: 6685 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.212067:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9774973 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb94 expref: 11 pid: 6685 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.212102:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787790765.212107:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787790765.212114:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004ead7b79/0x70647b5fa97749b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.212158:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ead7b79/0x70647b5fa97749b2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.212198:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790765.212310:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81198f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+10:2347:x1874634236542848:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 593us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790765.212320:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 50 00010000:00010000:2.0:1787790765.212391:0:6683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004ead7b79/0x70647b5fa97749b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.212402:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ead7b79/0x70647b5fa97749b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.212434:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ead7b79/0x70647b5fa97749b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.212443:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ead7b79/0x70647b5fa97749b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.212468:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ead7b79/0x70647b5fa97749b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.212476:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705200 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:2.0:1787790765.212482:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ead7b79/0x70647b5fa97749b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.212493:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ead7b79/0x70647b5fa97749b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.212507:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ead7b79/0x70647b5fa97749b2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.212515:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ead7b79/0x70647b5fa97749b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790765.212570:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81198b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:2347:x1874634236542592:12345-192.168.201.25@tcp:1:lfs.0 Request processed in 9042us (9459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790765.212579:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:3.0:1787790765.218979:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790765.219046:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236543104 00000100:00100000:0.0:1787790765.219058:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236543104 00000100:00100000:0.0:1787790765.219194:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:0.0:1787790765.219206:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4a6bbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+38:10514:x1874634236543104:12345-192.168.201.25@tcp:35:lfs.0 00000004:00010000:0.0:1787790765.219294:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa97749a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eba9 expref: 38 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787790765.219657:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1787790765.219705:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1787790765.220513:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1787790765.220575:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.220595:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa977495e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb86 expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.220606:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749b9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.220663:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa977495e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb86 expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.220681:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa977495e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb86 expref: 42 pid: 5847 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790765.220698:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a811992c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874634253335296:192.168.201.25@tcp:104: 00000100:00100000:0.0:1787790765.221056:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790765.222923:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a811992c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874634253335296:192.168.201.25@tcp:104: 00010000:00010000:3.0:1787790765.222958:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790765.223481:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790765.223572:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236543232 00000100:00100000:1.0:1787790765.223580:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236543232 00010000:00010000:1.0:1787790765.223676:0:8498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa977495e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb86 expref: 43 pid: 5847 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790765.223869:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:1.0:1787790765.223879:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+43:2348:x1874634236543232:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790765.223901:0:8498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790765.223910:0:8498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa977495e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb86 expref: 43 pid: 5847 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.223923:0:8498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa977495e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb86 expref: 43 pid: 5847 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.223950:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa977495e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb86 expref: 43 pid: 5847 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.223971:0:8498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:1.0:1787790765.223992:0:8498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.224003:0:8498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.224012:0:8498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749b9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.224046:0:8498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790765.224134:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+42:2348:x1874634236543232:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 256us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790765.224143:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 51 00010000:00010000:0.0:1787790765.224346:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.224355:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787790765.224513:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1787790765.224807:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1787790765.224935:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8119b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874634253335424:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787790765.224995:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790765.225028:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e823c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790765.225892:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253335424 00000100:00100000:2.0:1787790765.225903:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253335424 00000100:00100000:2.0:1787790765.225957:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787790765.225967:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a811992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5849:x1874634253335424:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787790765.226077:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a811992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5849:x1874634253335424:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 110us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790765.226195:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8119b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874634253335424:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787790765.226926:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1787790765.227008:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8119b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874634253335552:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787790765.227057:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790765.227075:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790765.227203:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787790765.227226:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253335552 00000100:00100000:2.0:1787790765.227231:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253335552 00000100:00100000:2.0:1787790765.227250:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787790765.227256:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5849:x1874634253335552:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787790765.227435:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5849:x1874634253335552:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 177us (377us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787790765.227441:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787790765.227860:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8119b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874634253335552:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787790765.227922:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1787790765.227975:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.227986:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749b9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.227994:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.228001:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790765.228005:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.228014:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749b9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.228031:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:0.0:1787790765.228035:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787790765.228040:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749b9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.228047:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749b9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787790765.228526:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787790765.228691:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1787790765.228704:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 300108979331ns, next at 301108976776ns, rc = 0 00000001:00080000:0.0:1787790765.228712:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1787790765.228782:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:0.0:1787790765.228786:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787790765.228794:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa97749a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eba9 expref: 46 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790765.228967:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4a6bbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+45:10514:x1874634236543104:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 9762us (9999us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1787790765.228979:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 26 00000020:00080000:0.0:1787790765.228986:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787790765.232130:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790765.232265:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236543360 00000100:00100000:1.0:1787790765.232277:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236543360 00000100:00100000:1.0:1787790765.232348:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 100 00000100:00100000:1.0:1787790765.232358:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+45:10514:x1874634236543360:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1787790765.232388:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790765.232418:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa97749c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ebb0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.232497:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa97749c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebb0 expref: 46 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.232513:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa97749c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebb0 expref: 46 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.232532:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:1.0:1787790765.232535:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787790765.232554:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45704400, rc 0) 00000100:00100000:1.0:1787790765.232624:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+46:10514:x1874634236543360:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 269us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790765.232631:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 100 00000100:00100000:1.0:1787790765.237248:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790765.237430:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236543616 00000100:00100000:2.0:1787790765.237443:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236543616 00000100:00100000:2.0:1787790765.237551:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:2.0:1787790765.237564:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+46:10514:x1874634236543616:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1787790765.237942:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+47:10514:x1874634236543616:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 380us (709us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787790765.237951:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:3.0:1787790765.302836:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790765.302952:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236543744 00000100:00100000:0.0:1787790765.302965:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236543744 00000100:00100000:0.0:1787790765.303061:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 101 00000100:00100000:0.0:1787790765.303073:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+47:10524:x1874634236543744:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:0.0:1787790765.303205:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303229:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303243:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303264:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97749ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303272:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97749ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303279:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97749ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303421:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa97749d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303451:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa97749d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303458:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa97749d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790765.303515:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa97749d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303530:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303536:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303543:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303549:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790765.303554:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303562:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303576:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:0.0:1787790765.303580:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790765.303586:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303593:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa97749c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303616:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97749ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303622:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97749ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303629:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97749ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303635:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790765.303638:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97749ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303644:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97749ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303650:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff931a49c31900) 00010000:00010000:0.0:1787790765.303652:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790765.303654:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97749ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303658:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa97749ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303669:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa97749d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303672:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa97749d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303676:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa97749d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303689:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41478800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790765.303692:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa97749d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303698:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa97749d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303706:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:0.0:1787790765.303708:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790765.303711:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa97749d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.303717:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa97749d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790765.303854:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+47:10524:x1874634236543744:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 780us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790765.303864:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 101 00000100:00100000:3.0:1787790765.323845:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790765.323909:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236544000 00000100:00100000:1.0:1787790765.323919:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236544000 00000100:00100000:1.0:1787790765.323986:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 102 00000100:00100000:1.0:1787790765.323994:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+47:10527:x1874634236544000:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1787790765.324018:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790765.324042:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97749dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ebb7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324147:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa97749e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324174:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa97749e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324189:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa97749e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324207:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa97749ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324214:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa97749ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324221:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa97749ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324419:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97749f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324426:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97749f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324431:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97749f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790765.324439:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787790765.324546:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa97749e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324551:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa97749e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324556:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa97749e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324560:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790765.324564:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa97749e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324570:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa97749e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324581:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:1.0:1787790765.324583:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790765.324597:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa97749e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324610:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa97749e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324622:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa97749ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324627:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa97749ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324630:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa97749ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324633:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790765.324635:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa97749ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324638:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa97749ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324643:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff931a488be300) 00010000:00010000:1.0:1787790765.324644:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790765.324646:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa97749ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324649:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa97749ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324690:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97749dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebb7 expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324700:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97749f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebb7 expref: 49 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.324710:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:1.0:1787790765.324712:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787790765.324714:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45705400, rc 0) 00000100:00100000:1.0:1787790765.324835:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+49:10527:x1874634236544000:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 840us (1002us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787790765.324844:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 102 00000100:00100000:1.0:1787790765.326691:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790765.326791:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236544128 00000100:00100000:3.0:1787790765.326799:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236544128 00000100:00100000:3.0:1787790765.326850:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 103 00000100:00100000:3.0:1787790765.326860:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+49:10527:x1874634236544128:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:3.0:1787790765.326943:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa97749ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.326957:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa97749ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.326965:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa97749ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.326987:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa97749ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.326993:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa97749ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.326998:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa97749ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.327002:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790765.327005:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa97749ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.327009:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa97749ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.327017:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:3.0:1787790765.327019:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787790765.327022:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa97749ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.327026:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa97749ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790765.327098:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+49:10527:x1874634236544128:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 239us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790765.327106:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 103 00000100:00100000:3.0:1787790765.328329:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790765.328419:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236544384 00000100:00100000:0.0:1787790765.328427:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236544384 00000100:00100000:0.0:1787790765.328471:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:0.0:1787790765.328480:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+49:10527:x1874634236544384:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:0.0:1787790765.328767:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+50:10527:x1874634236544384:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 286us (445us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1787790765.328775:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:0.0:1787790765.377170:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790765.377654:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236544640 00000100:00100000:1.0:1787790765.377668:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236544640 00000100:00100000:1.0:1787790765.377783:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 104 00000100:00100000:1.0:1787790765.377797:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81199e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+50:10537:x1874634236544640:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1787790765.377831:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790765.377834:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787790765.377866:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa9774981 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb9b expref: 50 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.377887:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:1.0:1787790765.377892:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790765.377905:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774a06 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ebbe expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.378022:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774a0d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.378034:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97749f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebb7 expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.378059:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774a0d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.378214:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97749f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebb7 expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.378231:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97749f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebb7 expref: 50 pid: 5848 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790765.378253:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be29680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874634253335680:192.168.201.25@tcp:104: 00000100:00100000:1.0:1787790765.378494:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47a34000 going to sleep for 11 seconds 00000100:00100000:1.0:1787790765.380978:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790765.381045:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236544768 00000100:00100000:0.0:1787790765.381055:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236544768 00010000:00010000:0.0:1787790765.381129:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97749f1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebb7 expref: 51 pid: 5848 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790765.381184:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:0.0:1787790765.381198:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db69a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+51:2349:x1874634236544768:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790765.381215:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790765.381223:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97749f1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebb7 expref: 51 pid: 5848 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.381239:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97749f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebb7 expref: 51 pid: 5848 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.381264:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:0.0:1787790765.381270:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774a0d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.381276:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97749f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebb7 expref: 51 pid: 5848 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.381280:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774a0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.381288:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774a0d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790765.381294:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be29680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874634253335680:192.168.201.25@tcp:104: 00010000:00010000:0.0:1787790765.381307:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790765.381368:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db69a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+50:2349:x1874634236544768:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 172us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790765.381376:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 52 00010000:00010000:2.0:1787790765.381587:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774a0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.381598:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774a0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.381604:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774a0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790765.381634:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787790765.382368:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774a06 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebbe expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.382388:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774a0d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebbe expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.382395:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:2.0:1787790765.382396:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787790765.382399:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45704e00, rc 0) 00000100:00100000:2.0:1787790765.382441:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81199e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+50:10537:x1874634236544640:12345-192.168.201.25@tcp:101:bash.0 Request processed in 4648us (5286us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787790765.382448:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 104 00000100:00100000:1.0:1787790765.384640:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790765.384785:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236545024 00000100:00100000:0.0:1787790765.384799:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236545024 00000100:00100000:0.0:1787790765.384907:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 105 00000100:00100000:0.0:1787790765.384933:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+50:10537:x1874634236545024:12345-192.168.201.25@tcp:36:bash.0 00010000:00010000:0.0:1787790765.385302:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774a1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.385323:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774a1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.385336:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774a1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787790765.385390:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1787790765.385412:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000efc3ba97 reply state 00000000101ea382 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774a1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790765.385422:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787790765.385524:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+53:10537:x1874634236545024:12345-192.168.201.25@tcp:36:bash.0 Request processed in 594us (896us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787790765.385532:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 105 00000020:00080000:0.0:1787790765.385538:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787790765.388616:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790765.388659:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236545152 00000100:00100000:3.0:1787790765.388669:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236545152 00000100:00100000:3.0:1787790765.388747:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 106 00000100:00100000:3.0:1787790765.388755:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+53:10537:x1874634236545152:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1787790765.388781:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790765.388800:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774a22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ebc5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.388882:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774a29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.388896:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774a0d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebbe expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.388902:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774a1b lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.388907:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774a29 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.388923:0:5847:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774a1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.388965:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774a0d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebbe expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.388977:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774a0d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebbe expref: 54 pid: 5848 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790765.388989:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d8ef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874634253335808:192.168.201.25@tcp:104: 00000100:00100000:3.0:1787790765.389067:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a478f13c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787790765.389252:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774a1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.389261:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774a1b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.389268:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774a1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.389275:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790765.389279:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774a1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.389292:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774a1b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.389320:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:1.0:1787790765.389324:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790765.389327:0:3304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774a29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.389337:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774a1b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.389344:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774a1b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790765.391801:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d8ef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874634253335808:192.168.201.25@tcp:104: 00010000:00010000:3.0:1787790765.391834:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774a29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790765.392185:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790765.392310:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236545280 00000100:00100000:1.0:1787790765.392318:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236545280 00010000:00010000:1.0:1787790765.392363:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774a0d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebbe expref: 54 pid: 5848 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790765.392403:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 53 00000100:00100000:1.0:1787790765.392414:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+54:2348:x1874634236545280:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790765.392431:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790765.392438:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774a0d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebbe expref: 54 pid: 5848 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.392450:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774a0d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebbe expref: 54 pid: 5848 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.392478:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774a0d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebbe expref: 54 pid: 5848 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.392516:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:1.0:1787790765.392522:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774a29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.392531:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774a29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.392539:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774a29 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.392576:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790765.392647:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+53:2348:x1874634236545280:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 234us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790765.392655:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 53 00010000:00010000:2.0:1787790765.392847:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774a29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.392856:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774a29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790765.392916:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787790765.392922:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787790765.392947:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774a29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.392982:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774a22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebc5 expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.392998:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774a29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebc5 expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790765.393013:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:2.0:1787790765.393016:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790765.393018:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153600, rc 0) 00000100:00100000:2.0:1787790765.393060:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+52:10537:x1874634236545152:12345-192.168.201.25@tcp:101:bash.0 Request processed in 4305us (4458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790765.393068:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 106 00000100:00100000:3.0:1787790765.397317:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790765.397479:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236545536 00000100:00100000:2.0:1787790765.397491:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236545536 00000100:00100000:2.0:1787790765.397566:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 29 00000100:00100000:2.0:1787790765.397578:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+52:10537:x1874634236545536:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:2.0:1787790765.397936:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+53:10537:x1874634236545536:12345-192.168.201.25@tcp:35:bash.0 Request processed in 360us (633us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1787790765.397944:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 29 00000100:00100000:3.0:1787790765.445342:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790765.445598:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236545664 00000100:00100000:0.0:1787790765.445611:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236545664 00000100:00100000:0.0:1787790765.445701:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 107 00000100:00100000:0.0:1787790765.445714:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+53:10543:x1874634236545664:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1787790765.445797:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790765.445828:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774a30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ebcc expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.445917:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774a37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.445961:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.445975:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790765.446128:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787790765.446141:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787790765.446182:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.446214:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774a30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebcc expref: 55 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.446238:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774a37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebcc expref: 54 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.446247:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:1.0:1787790765.446251:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787790765.446254:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41479800, rc 0) 00000100:00100000:1.0:1787790765.446344:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+54:10543:x1874634236545664:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 633us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790765.446352:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 107 00000100:00100000:1.0:1787790765.450466:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790765.450533:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236545792 00000100:00100000:3.0:1787790765.450545:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236545792 00000100:00100000:3.0:1787790765.450694:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 108 00000100:00100000:3.0:1787790765.450706:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+54:10543:x1874634236545792:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1787790765.450763:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790765.450790:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774a3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ebd3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.450870:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774a45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.450910:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774a45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.450923:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774a45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.450940:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774a4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.450947:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774a4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.450954:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774a4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.451080:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774a53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.451089:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774a53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.451096:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774a53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790765.451155:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787790765.451161:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787790765.451312:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774a53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.451337:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774a53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.451359:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774a45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.451366:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774a45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.451373:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774a45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.451380:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790765.451385:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774a45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.451394:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774a45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.451410:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:3.0:1787790765.451413:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790765.451419:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774a45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.451425:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774a45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.451440:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774a4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.451447:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774a4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.451453:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774a4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.451465:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790765.451468:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774a4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.451474:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774a4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.451482:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff931a541ad200) 00010000:00010000:3.0:1787790765.451485:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790765.451488:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774a4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.451495:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774a4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.451533:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774a3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebd3 expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.451550:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774a53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebd3 expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.451558:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:3.0:1787790765.451561:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787790765.451564:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153200, rc 0) 00000100:00100000:3.0:1787790765.451640:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+55:10543:x1874634236545792:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 936us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790765.451650:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 108 00000100:00100000:2.0:1787790765.459247:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790765.459405:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236546048 00000100:00100000:0.0:1787790765.459418:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236546048 00000100:00100000:0.0:1787790765.459497:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 109 00000100:00100000:0.0:1787790765.459509:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931946937840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+55:10543:x1874634236546048:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1787790765.459537:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790765.459566:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774a5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ebda expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.459753:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774a61 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.459773:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774a29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebc5 expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.459783:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774a53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebd3 expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.459793:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774a61 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.459838:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774a53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebd3 expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.459878:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774a53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebd3 expref: 56 pid: 5848 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790765.459894:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8119b840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874634253335936:192.168.201.25@tcp:104: 00010000:00010000:0.0:1787790765.460013:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774a29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebc5 expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.460022:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774a29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebc5 expref: 56 pid: 5847 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790765.460030:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8119a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874634253336064:192.168.201.25@tcp:104: 00000100:00100000:0.0:1787790765.460058:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82600 going to sleep for 11 seconds 00000100:00100000:0.0:1787790765.464025:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8119b840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874634253335936:192.168.201.25@tcp:104: 00000100:00100000:0.0:1787790765.464045:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8119a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874634253336064:192.168.201.25@tcp:104: 00010000:00010000:0.0:1787790765.464086:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774a61 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790765.464221:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790765.464556:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236546176 00000100:00100000:1.0:1787790765.464564:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236546176 00010000:00010000:1.0:1787790765.464622:0:8498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774a53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebd3 expref: 57 pid: 5848 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790765.464666:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 54 00000100:00100000:1.0:1787790765.464677:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be29680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+57:2346:x1874634236546176:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790765.464698:0:8498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790765.464706:0:8498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774a53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebd3 expref: 57 pid: 5848 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.464721:0:8498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774a53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebd3 expref: 57 pid: 5848 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.464766:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774a53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebd3 expref: 57 pid: 5848 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.464783:0:8498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:1.0:1787790765.464789:0:8498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774a61 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.464799:0:8498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774a61 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.464830:0:8498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790765.464910:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be29680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+56:2346:x1874634236546176:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 234us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790765.464919:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 54 00000100:00100000:2.0:1787790765.467407:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790765.467520:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236546304 00000100:00100000:1.0:1787790765.467532:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236546304 00010000:00010000:1.0:1787790765.467583:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774a29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebc5 expref: 56 pid: 5847 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790765.467879:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00100000:1.0:1787790765.467891:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a493cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+56:2346:x1874634236546304:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790765.467910:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790765.467918:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774a29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebc5 expref: 56 pid: 5847 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.467932:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774a29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebc5 expref: 56 pid: 5847 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.467960:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774a29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebc5 expref: 56 pid: 5847 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.467978:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:1.0:1787790765.467984:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774a61 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.467995:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774a61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.468022:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774a61 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.468049:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790765.468133:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a493cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+55:2346:x1874634236546304:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 243us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790765.468143:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 55 00010000:00010000:0.0:1787790765.468274:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774a61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.468284:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774a61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790765.468309:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787790765.468517:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774a5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebda expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.468550:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774a61 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebda expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.468558:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:0.0:1787790765.468561:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787790765.468563:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a40030a00, rc 0) 00000100:00100000:0.0:1787790765.468604:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931946937840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+55:10543:x1874634236546048:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 9098us (9376us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787790765.468612:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 109 00000100:00100000:2.0:1787790765.472138:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790765.472338:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236546560 00000100:00100000:3.0:1787790765.472367:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236546560 00000100:00100000:3.0:1787790765.472445:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:3.0:1787790765.472457:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be29680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+55:10543:x1874634236546560:12345-192.168.201.25@tcp:103:lfs.0 00010000:00010000:3.0:1787790765.472477:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790765.472509:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa97749c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebb0 expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790765.472533:0:11653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:3.0:1787790765.472540:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790765.472626:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be29680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+54:10543:x1874634236546560:12345-192.168.201.25@tcp:103:lfs.0 Request processed in 171us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790765.472635:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:3.0:1787790765.475517:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790765.476099:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236546688 00000100:00100000:0.0:1787790765.476111:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236546688 00000100:00100000:0.0:1787790765.476282:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 110 00000100:00100000:0.0:1787790765.476294:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+54:10543:x1874634236546688:12345-192.168.201.25@tcp:58:lfs.0 00010000:00010000:0.0:1787790765.476461:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774a6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.476482:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774a6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790765.476495:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774a6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787790765.477069:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1787790765.477274:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+54:10543:x1874634236546688:12345-192.168.201.25@tcp:58:lfs.0 Request processed in 979us (1768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790765.477286:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 110 00000100:00100000:2.0:1787790765.479984:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790765.480084:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236546816 00000100:00100000:1.0:1787790765.480096:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236546816 00000100:00100000:1.0:1787790765.480268:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 111 00000100:00100000:1.0:1787790765.480280:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d80a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+54:10543:x1874634236546816:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1787790765.480308:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790765.480345:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705000/0x70647b5fa9774a76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ebe1 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.480422:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774a6f lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.480435:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705000/0x70647b5fa9774a76 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebe1 expref: 55 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.480459:0:7920:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774a6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.480476:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705000/0x70647b5fa9774a76 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebe1 expref: 55 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.480493:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:1.0:1787790765.480513:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787790765.480518:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705000/0x70647b5fa9774a76 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebe1 expref: 55 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790765.480527:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45705000, rc 0) 00000100:00100000:1.0:1787790765.480615:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d80a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+55:10543:x1874634236546816:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 338us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790765.480623:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 111 00010000:00010000:1.0:1787790765.824006:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787790766.145416:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787790766.145448:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787790766.145512:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787790766.145521:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787790766.145686:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8119a1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874634253336192:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787790766.145840:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4a8d4180 going to sleep for 11 seconds 00000100:00100000:0.0:1787790766.152189:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8119a1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874634253336192:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787790766.154933:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790766.155333:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236546944 00000100:00100000:2.0:1787790766.155348:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236546944 00000100:00100000:2.0:1787790766.155430:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 112 00000100:00100000:2.0:1787790766.155440:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+55:10546:x1874634236546944:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787790766.155474:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787790766.155590:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+55:10546:x1874634236546944:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 151us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790766.155615:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 112 00000100:00100000:2.0:1787790766.161618:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790766.164098:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236547072 00000100:00100000:0.0:1787790766.164122:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236547072 00000100:00100000:0.0:1787790766.164200:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 113 00000100:00100000:0.0:1787790766.164211:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+55:10546:x1874634236547072:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787790766.164308:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774a7d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.164326:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774a7d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.164341:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774a7d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.164399:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774a84 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.164407:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774a84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.164415:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774a84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.164440:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774a8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.164459:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.164467:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790766.164509:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787790766.164514:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787790766.164527:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.165088:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774a7d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.165096:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774a7d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.165103:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774a7d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.165120:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790766.165124:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774a7d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.165131:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774a7d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.165144:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff931a4b7e7200) 00010000:00010000:0.0:1787790766.165147:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790766.165151:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774a7d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.165168:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774a7d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.165185:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774a84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.165192:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774a84 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.165198:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774a84 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.165203:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790766.165206:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774a84 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.165213:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774a84 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.165220:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff931a49c31900) 00010000:00010000:0.0:1787790766.165223:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790766.165226:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774a84 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.165232:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774a84 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.165246:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.165253:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774a8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.165264:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774a8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.165270:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790766.165272:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774a8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.165279:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774a8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.165287:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:0.0:1787790766.165289:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790766.165292:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774a8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.165298:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774a8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790766.165379:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+55:10546:x1874634236547072:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 Request processed in 1169us (3779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790766.165388:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 113 00000100:00100000:3.0:1787790766.171068:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790766.171215:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236547328 00000100:00100000:2.0:1787790766.171230:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236547328 00000100:00100000:2.0:1787790766.171295:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 114 00000100:00100000:2.0:1787790766.171303:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+55:10546:x1874634236547328:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787790766.171322:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790766.171341:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa9774a92 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ebe8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.171430:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774a99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.171444:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774a99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.171455:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774a99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790766.171466:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787790766.171556:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774a99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.171564:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774a99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.171571:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774a99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.171576:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654e000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790766.171593:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774a99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.171601:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774a99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.171613:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:2.0:1787790766.171616:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787790766.171620:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774a99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.171638:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774a99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.171679:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa9774a92 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebe8 expref: 57 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.171689:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff931a4b7e7200) 00010000:00010000:2.0:1787790766.171692:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787790766.171695:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa9774a92 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebe8 expref: 57 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.171704:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654ea00, rc 0) 00000100:00100000:2.0:1787790766.171802:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+56:10546:x1874634236547328:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 499us (1457us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787790766.171810:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 114 00000100:00100000:3.0:1787790766.186463:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790766.187218:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236547456 00000100:00100000:1.0:1787790766.187229:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236547456 00000100:00100000:1.0:1787790766.187355:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 115 00000100:00100000:1.0:1787790766.187366:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+56:10546:x1874634236547456:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787790766.187428:0:7920:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787790766.187552:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+56:10546:x1874634236547456:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 188us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790766.187560:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 115 00000100:00100000:1.0:1787790766.200321:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790766.202659:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236547712 00000100:00100000:2.0:1787790766.202675:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236547712 00000100:00100000:2.0:1787790766.202773:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 116 00000100:00100000:2.0:1787790766.202784:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+56:10546:x1874634236547712:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787790766.202821:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790766.202825:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787790766.202853:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774a37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebcc expref: 56 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.202873:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:2.0:1787790766.202877:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790766.202891:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa9774aa7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ebef expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787790766.203310:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787790766.203500:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774aae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.203514:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774aae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.203525:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774aae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.203572:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa9774aa7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebef expref: 58 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.203588:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774aae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebef expref: 57 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.203596:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff931a4b7e7b00) 00010000:00010000:2.0:1787790766.203599:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790766.203611:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654e000, rc 0) 00000100:00100000:2.0:1787790766.203681:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+57:10546:x1874634236547712:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 898us (3369us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787790766.203689:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 116 00000100:00100000:3.0:1787790766.212331:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790766.212438:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236547968 00000100:00100000:0.0:1787790766.212448:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236547968 00000100:00100000:0.0:1787790766.212508:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 117 00000100:00100000:0.0:1787790766.212517:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+57:10546:x1874634236547968:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787790766.212574:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790766.212599:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774aae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebef expref: 57 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.212638:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff931a4b7e7b00) 00010000:00010000:0.0:1787790766.212649:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787790766.212680:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774abc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.212695:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774abc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.212704:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774abc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.212960:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774ac3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xd804f06d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.212969:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd804f06d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.212975:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd804f06d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.213050:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774abc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.213057:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774abc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.213063:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774abc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.213068:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790766.213072:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774abc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.213085:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774abc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.213094:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:0.0:1787790766.213097:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790766.213100:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774abc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.213116:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774abc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.213127:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd804f06d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.213132:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774ac3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd804f06d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.213137:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774ac3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd804f06d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.213142:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790766.213145:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774ac3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd804f06d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.213151:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774ac3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd804f06d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.213158:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xd804f06d (ffff931a49c31900) 00010000:00010000:0.0:1787790766.213160:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790766.213162:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774ac3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd804f06d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.213178:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774ac3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd804f06d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790766.213265:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+56:10546:x1874634236547968:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 748us (942us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787790766.213272:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 117 00000100:00100000:3.0:1787790766.217530:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790766.217624:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236548096 00000100:00100000:0.0:1787790766.217633:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236548096 00000100:00100000:0.0:1787790766.217694:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 118 00000100:00100000:0.0:1787790766.217703:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+56:10546:x1874634236548096:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787790766.217746:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790766.217770:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774aca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ebf6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.217808:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa9774ad1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.217821:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa9774ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.217832:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa9774ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.217932:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774aca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebf6 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.217958:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa9774ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebf6 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.217977:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff931a49c31600) 00010000:00010000:0.0:1787790766.217980:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787790766.217984:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67980800, rc 0) 00000100:00100000:0.0:1787790766.218051:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+57:10546:x1874634236548096:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 349us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790766.218059:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 118 00000100:00100000:1.0:1787790766.224720:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790766.224871:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236548352 00000100:00100000:3.0:1787790766.224880:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236548352 00000100:00100000:3.0:1787790766.224944:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 119 00000100:00100000:3.0:1787790766.224954:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+57:10546:x1874634236548352:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787790766.225034:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ad8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.225051:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.225079:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787790766.225357:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1787790766.225368:0:7920:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 301105643236ns, next at 302105640784ns, rc = 0 00000004:00010000:3.0:1787790766.225448:0:7920:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ebd610e reply state 0000000046c88aa5 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790766.225458:0:7920:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787790766.225548:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+59:10546:x1874634236548352:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 595us (837us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1787790766.225555:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 119 00010000:00010000:1.0:1787790766.227376:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.227394:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ad8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.227405:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ad8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.227412:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790766.227431:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ad8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.227440:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ad8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.227458:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff931a49c31600) 00010000:00010000:1.0:1787790766.227464:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787790766.227469:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ad8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.227476:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ad8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790766.239131:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790766.239452:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236548480 00000100:00100000:0.0:1787790766.239461:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236548480 00000100:00100000:0.0:1787790766.239520:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 120 00000100:00100000:0.0:1787790766.239529:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+58:10546:x1874634236548480:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787790766.239552:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790766.239571:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774adf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ebfd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.239627:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774adf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebfd expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.239642:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774adf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebfd expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.239711:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff931a49c31600) 00010000:00010000:0.0:1787790766.239715:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787790766.239720:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67980a00, rc 0) 00000100:00100000:0.0:1787790766.243408:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+59:10546:x1874634236548480:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 3868us (4274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790766.243440:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 120 00000100:00100000:3.0:1787790766.249464:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790766.249955:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236548608 00000100:00100000:2.0:1787790766.249967:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236548608 00000100:00100000:2.0:1787790766.250038:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00100000:2.0:1787790766.250048:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be39a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2349:x1874634236548608:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787790766.250330:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be39a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:2349:x1874634236548608:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 282us (876us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787790766.250338:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00080000:3.0:1787790766.250753:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790766.254063:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790766.254170:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236548864 00000100:00100000:2.0:1787790766.254181:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236548864 00000100:00100000:2.0:1787790766.254242:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 30 00000100:00100000:2.0:1787790766.254253:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+59:10546:x1874634236548864:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787790766.255224:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+60:10546:x1874634236548864:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 967us (1163us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787790766.255234:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 30 00000100:00100000:1.0:1787790766.260350:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790766.260456:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236549120 00000100:00100000:3.0:1787790766.260464:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236549120 00000100:00100000:3.0:1787790766.260559:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 121 00000100:00100000:3.0:1787790766.260567:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+60:10546:x1874634236549120:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787790766.260852:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+60:10546:x1874634236549120:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 286us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790766.260858:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 121 00000100:00100000:3.0:1787790766.267560:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790766.269593:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236549248 00000100:00100000:2.0:1787790766.269608:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236549248 00000100:00100000:2.0:1787790766.269701:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 122 00000100:00100000:2.0:1787790766.269713:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+60:10546:x1874634236549248:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787790766.270421:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790766.270450:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774ae6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec04 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.271317:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa9774aed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.271334:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa9774aed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.271347:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa9774aed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790766.271397:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787790766.271418:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa9774aed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.271452:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774ae6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec04 expref: 62 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.271478:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa9774aed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec04 expref: 61 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.271488:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff931a49c31600) 00010000:00010000:2.0:1787790766.271491:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787790766.271495:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654ea00, rc 0) 00000100:00100000:2.0:1787790766.271569:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+61:10546:x1874634236549248:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 1859us (4019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790766.271587:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 122 00000100:00100000:2.0:1787790766.278708:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790766.278851:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236549376 00000100:00100000:3.0:1787790766.278870:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236549376 00000100:00100000:3.0:1787790766.278939:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:3.0:1787790766.278949:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d80b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:2348:x1874634236549376:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787790766.278982:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790766.279001:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4187b93/0x70647b5fa9774af4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec0b expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787790766.279028:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f85ae, blocks: 0x1 00010000:00010000:3.0:1787790766.279046:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=301s v=(0 0) 00010000:00010000:3.0:1787790766.279051:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790766.279060:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4187b93/0x70647b5fa9774af4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec0b expref: 10 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.279079:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d4187b93/0x70647b5fa9774af4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec0b expref: 10 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.279091:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82152c00, rc 0) 00000100:00100000:3.0:1787790766.279158:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d80b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+10:2348:x1874634236549376:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 210us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790766.279165:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:1.0:1787790766.281554:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790766.281840:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236549632 00000100:00100000:0.0:1787790766.281849:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236549632 00000100:00100000:0.0:1787790766.281951:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 123 00000100:00100000:0.0:1787790766.281962:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+61:10546:x1874634236549632:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787790766.282074:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+61:10546:x1874634236549632:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 114us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790766.282081:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 123 00000100:00100000:0.0:1787790766.288314:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790766.288653:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236549760 00000100:00100000:1.0:1787790766.288664:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236549760 00000100:00100000:1.0:1787790766.288749:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:1.0:1787790766.288761:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+10:10546:x1874634236549760:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790766.288778:0:8297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790766.288795:0:8297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ac18e07/0x70647b5fa9774afb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec12 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.288829:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4187b93/0x70647b5fa9774af4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec0b expref: 11 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.288839:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790766.288853:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790766.288859:0:8297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ac18e07/0x70647b5fa9774afb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec12 expref: 11 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.288892:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4187b93/0x70647b5fa9774af4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec0b expref: 11 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.288905:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4187b93/0x70647b5fa9774af4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec0b expref: 11 pid: 6685 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790766.288919:0:8297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d8ef0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8297:1874634253336320:192.168.201.25@tcp:104: 00000100:00100000:1.0:1787790766.289332:0:8297:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47a34e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787790766.294597:0:8297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d8ef0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8297:1874634253336320:192.168.201.25@tcp:104: 00010000:00010000:1.0:1787790766.294644:0:8297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ac18e07/0x70647b5fa9774afb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec12 expref: 11 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.294666:0:8297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45705400, rc 0) 00000100:00100000:1.0:1787790766.294765:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+11:10546:x1874634236549760:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 6003us (6457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790766.294774:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:0.0:1787790766.296696:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790766.298142:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236549888 00000100:00100000:2.0:1787790766.298154:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236549888 00010000:00010000:2.0:1787790766.298216:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4187b93/0x70647b5fa9774af4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec0b expref: 11 pid: 6685 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790766.298264:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:2.0:1787790766.298275:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+11:2349:x1874634236549888:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790766.298296:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790766.298321:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4187b93/0x70647b5fa9774af4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec0b expref: 11 pid: 6685 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.298334:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4187b93/0x70647b5fa9774af4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec0b expref: 11 pid: 6685 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.298357:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4187b93/0x70647b5fa9774af4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec0b expref: 11 pid: 6685 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.298374:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790766.298379:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790766.298387:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ac18e07/0x70647b5fa9774afb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec12 expref: 10 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.298398:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ac18e07/0x70647b5fa9774afb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec12 expref: 10 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.298437:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008ac18e07/0x70647b5fa9774afb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec12 expref: 10 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790766.298462:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ccf0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5833:1874634253336448:192.168.201.25@tcp:105: 00000100:00100000:2.0:1787790766.298554:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a42f60f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790766.303356:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ccf0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5833:1874634253336448:192.168.201.25@tcp:105: 00010000:00010000:2.0:1787790766.303384:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790766.303439:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+10:2349:x1874634236549888:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 5166us (6751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790766.303451:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:3.0:1787790766.309188:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790766.310059:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236550016 00000100:00100000:2.0:1787790766.310071:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236550016 00002000:00100000:2.0:1787790766.310136:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff931a7be3b840 x1874634236550016/t0(0) o4->3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp:607/0 lens 504/0 e 0 to 0 dl 1787790777 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787790766.310147:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a7be3b840 with x1874634236550016 ext(0->12) 00002000:00010000:2.0:1787790766.310153:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff931a7be3b840 00000100:00100000:2.0:1787790766.310191:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:2.0:1787790766.310200:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be3b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+10:2349:x1874634236550016:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787790766.310702:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be3b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+12:2349:x1874634236550016:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 Request processed in 502us (1523us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787790766.310711:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 2 00002000:00100000:2.0:1787790766.310720:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff931a7be3b840 x1874634236550016/t4294967308(0) o4->3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp:607/0 lens 504/448 e 0 to 0 dl 1787790777 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787790766.310770:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a7be3b840 with x1874634236550016 ext(0->12) 00002000:00010000:2.0:1787790766.310774:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff931a7be3b840 00000100:00100000:3.0:1787790766.312695:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790766.312795:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236550144 00000100:00100000:0.0:1787790766.312804:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236550144 00000100:00100000:0.0:1787790766.312857:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 124 00000100:00100000:0.0:1787790766.312866:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be3ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+61:10546:x1874634236550144:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787790766.353865:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000004:00080000:1.0:1787790766.353889:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787790766.353907:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff931944e823c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787790766.353912:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff931a44e19f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff931944e82480 00000020:00080000:1.0:1787790766.353915:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff931a44e19b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff931a42eab400 00000020:00080000:1.0:1787790766.353954:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff931a4cbf7c00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787790766.353957:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff931a44e19800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff931a4cbf73c0 00000020:00080000:1.0:1787790766.353960:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff931a44e19e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff931a4bcbc400 00000020:00080000:2.0:1787790766.354095:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 0 00000001:00080000:1.0:1787790766.354113:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1787790766.354131:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787790766.354143:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:1.0:1787790766.354149:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1787790766.354380:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787790766.354401:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d8ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253336576:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787790766.354470:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790766.354497:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253336576 00000100:00100000:3.0:1787790766.354503:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253336576 00000100:00100000:2.0:1787790766.354508:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787790766.354514:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253336704:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787790766.354534:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790766.354541:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253336704 00000100:00100000:3.0:1787790766.354544:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253336704 00000100:00100000:3.0:1787790766.354567:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787790766.354582:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ccf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3320:x1874634253336576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787790766.354606:0:6685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1787790766.354643:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f85ad, atime: 0x6a8f85ad, ctime: 0x6a8f85ad, blocks: 0x1 00010000:00010000:3.0:1787790766.354651:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774b02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.354667:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=301s v=(0 0) 00010000:00010000:3.0:1787790766.354672:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790766.354678:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774b02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.354693:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774b02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.354702:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774b02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.354710:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774b02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.354749:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787790766.355126:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787790766.355136:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ccf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1874634253336704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787790766.355150:0:6684:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1787790766.355164:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa9774b09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.355179:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002559e762/0x70647b5fa97748c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb71 expref: 11 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.355187:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787790766.355190:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787790766.355194:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa9774b09 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.355220:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002559e762/0x70647b5fa97748c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb71 expref: 11 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.355233:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002559e762/0x70647b5fa97748c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb71 expref: 11 pid: 6683 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790766.355256:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53ee9680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1874634253336960:192.168.201.25@tcp:104: 00000100:00100000:2.0:1787790766.355431:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9c780 going to sleep for 11 seconds 00000100:00100000:3.0:1787790766.355434:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ccf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3320:x1874634253336576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 859us (963us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787790766.355441:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787790766.355464:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787790766.355473:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be3a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253336832:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787790766.355500:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790766.355534:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253336832 00000100:00100000:3.0:1787790766.355538:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253336832 00000100:00100000:3.0:1787790766.355557:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787790766.355569:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be38780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3319:x1874634253336832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787790766.355664:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787790766.355668:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787790766 00002000:00010000:3.0:1787790766.355670:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787790766.355673:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787790766 -> 1787790766 00002000:00010000:3.0:1787790766.355675:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787790766.355704:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be38780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3319:x1874634253336832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 136us (203us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787790766.355711:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1787790766.355750:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790766.355757:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774b02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.355766:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153e00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790766.355771:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774b02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.355781:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774b02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.355797:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774b02 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.355804:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774b02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.355823:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790766.355831:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790766.355833:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787790766.356088:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff931a7be3a580/2, rc 0, transno 4294967309 00000100:00100000:3.0:1787790766.356095:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be3a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253336832:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1787790766.356127:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff931a7d8ef0c0/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787790766.356132:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d8ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253336576:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787790766.357079:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be3ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+15:10546:x1874634236550144:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 Request processed in 44208us (44386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790766.357099:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 124 00000100:00100000:3.0:1787790766.358595:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790766.359767:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236550272 00000100:00100000:0.0:1787790766.359775:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236550272 00010000:00010000:0.0:1787790766.359810:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002559e762/0x70647b5fa97748c4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb71 expref: 12 pid: 6683 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790766.359843:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:0.0:1787790766.359849:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+12:2349:x1874634236550272:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790766.359873:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790766.359877:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002559e762/0x70647b5fa97748c4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb71 expref: 12 pid: 6683 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.359886:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002559e762/0x70647b5fa97748c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb71 expref: 12 pid: 6683 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.359912:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787790766.359915:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787790766.359919:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa9774b09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.359926:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa9774b09 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.359941:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790766.359984:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+12:2349:x1874634236550272:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 134us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790766.359992:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 57 00010000:00010000:2.0:1787790766.361058:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002559e762/0x70647b5fa97748c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb71 expref: 11 pid: 6683 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790766.361078:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53ee9680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1874634253336960:192.168.201.25@tcp:104: 00010000:00010000:2.0:1787790766.361098:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa9774b09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.361119:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa9774b09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.361127:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa9774b09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.361137:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa9774b09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.361145:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa9774b09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.361216:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787790766.361720:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ccf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3320:x1874634253336704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6586us (7184us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787790766.361751:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:3.0:1787790766.362132:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff931a7be3a1c0/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787790766.362144:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253336704:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787790766.362245:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790766.362312:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236550400 00000100:00100000:3.0:1787790766.362323:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236550400 00000100:00100000:3.0:1787790766.362372:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:3.0:1787790766.362381:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+11:2348:x1874634236550400:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1787790766.362604:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790766.362612:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa9774b09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.362623:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654e000 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790766.362628:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa9774b09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.362637:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa9774b09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.362655:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa9774b09 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.362664:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa9774b09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.362684:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790766.362686:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790766.362688:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787790766.390411:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1787790766.390431:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1787790766.390437:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1787790766.390446:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1787790766.395787:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2348:x1874634236550400:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 Request processed in 33392us (33529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790766.395803:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:3.0:1787790766.419862:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790766.420173:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236550656 00000100:00100000:1.0:1787790766.420183:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236550656 00000100:00100000:1.0:1787790766.420244:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 125 00000100:00100000:1.0:1787790766.420254:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+15:10546:x1874634236550656:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787790766.420309:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790766.420335:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa9774aed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec04 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.420354:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff931a49c31600) 00010000:00010000:1.0:1787790766.420359:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790766.420389:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774b10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.420402:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774b10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.420411:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774b10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790766.423691:0:7920:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000863063ba reply state 00000000646cdf98 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774b10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790766.423712:0:7920:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787790766.423873:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+16:10546:x1874634236550656:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 3616us (4015us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787790766.423882:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 125 00010000:00010000:3.0:1787790766.427280:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774b10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.427297:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774b10 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.427305:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774b10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.427311:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790766.427316:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774b10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.427324:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774b10 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.427354:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff931a49c31600) 00010000:00010000:3.0:1787790766.427356:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790766.427361:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774b10 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.427368:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774b10 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790766.429313:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790766.431041:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236550784 00000100:00100000:0.0:1787790766.431062:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236550784 00000100:00100000:0.0:1787790766.431140:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:0.0:1787790766.431150:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a80f51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2348:x1874634236550784:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787790766.431386:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787790766.431390:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787790766 -> 1787790765 00002000:00010000:0.0:1787790766.431393:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787790765 00002000:00010000:0.0:1787790766.431395:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787790766 -> 1787790765 00002000:00010000:0.0:1787790766.431397:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787790766.431459:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a80f51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2348:x1874634236550784:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 310us (2155us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787790766.431466:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:1.0:1787790766.437860:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790766.438024:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236551040 00000100:00100000:3.0:1787790766.438035:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236551040 00000100:00100000:3.0:1787790766.438118:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 126 00000100:00100000:3.0:1787790766.438128:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+15:10546:x1874634236551040:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787790766.438193:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa9774b17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.438211:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa9774ad1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebf6 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.438221:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa9774b17 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.438253:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa9774ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebf6 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.438266:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa9774ad1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebf6 expref: 15 pid: 5847 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790766.438280:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be38b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874634253337088:192.168.201.25@tcp:104: 00000100:00100000:3.0:1787790766.438381:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a478f1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790766.441557:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790766.441638:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236551168 00000100:00100000:1.0:1787790766.441647:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236551168 00010000:00010000:1.0:1787790766.441690:0:8498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa9774ad1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebf6 expref: 16 pid: 5847 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790766.441754:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 58 00000100:00100000:1.0:1787790766.441763:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be38f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+16:2348:x1874634236551168:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790766.441777:0:8498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790766.441784:0:8498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa9774ad1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebf6 expref: 16 pid: 5847 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.441798:0:8498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa9774ad1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebf6 expref: 16 pid: 5847 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.441819:0:8498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff931a49c31600) 00010000:00010000:1.0:1787790766.441824:0:8498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa9774b17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.441834:0:8498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa9774b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.441854:0:8498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa9774b17 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.441873:0:8498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790766.441941:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be38f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+16:2348:x1874634236551168:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 178us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790766.441950:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 58 00010000:00010000:2.0:1787790766.442622:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa9774ad1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebf6 expref: 15 pid: 5847 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790766.442641:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be38b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874634253337088:192.168.201.25@tcp:104: 00010000:00010000:2.0:1787790766.442675:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa9774b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.442685:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa9774b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.442692:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa9774b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.442720:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa9774b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.442754:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa9774b17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.442760:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa9774b17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.442766:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790766.442770:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa9774b17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.442778:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa9774b17 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.442802:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff931a49c31600) 00010000:00010000:2.0:1787790766.442805:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787790766.442810:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa9774b17 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.442816:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa9774b17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790766.442888:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+14:10546:x1874634236551040:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 Request processed in 4760us (5049us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787790766.442897:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 126 00000100:00100000:3.0:1787790766.450610:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790766.450717:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236551296 00000100:00100000:0.0:1787790766.450772:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236551296 00000100:00100000:0.0:1787790766.450827:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:0.0:1787790766.450847:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2347:x1874634236551296:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787790766.450893:0:8297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f6cfc8fe/0x70647b5fa9774b1e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.450926:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ac18e07/0x70647b5fa9774afb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec12 expref: 7 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.450936:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790766.450941:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787790766.450945:0:8297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6cfc8fe/0x70647b5fa9774b1e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.450981:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ac18e07/0x70647b5fa9774afb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec12 expref: 7 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.451014:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ac18e07/0x70647b5fa9774afb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec12 expref: 7 pid: 8297 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790766.451029:0:8297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8119ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8297:1874634253337216:192.168.201.25@tcp:104: 00000100:00100000:0.0:1787790766.451123:0:8297:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67d4b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787790766.459787:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790766.461979:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236551424 00000100:00100000:2.0:1787790766.461991:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236551424 00010000:00010000:2.0:1787790766.462039:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ac18e07/0x70647b5fa9774afb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec12 expref: 8 pid: 8297 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790766.462091:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:2.0:1787790766.462110:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2349:x1874634236551424:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790766.462126:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790766.462150:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ac18e07/0x70647b5fa9774afb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec12 expref: 8 pid: 8297 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.462165:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ac18e07/0x70647b5fa9774afb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec12 expref: 8 pid: 8297 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.462191:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787790766.462196:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787790766.462214:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6cfc8fe/0x70647b5fa9774b1e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.462225:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6cfc8fe/0x70647b5fa9774b1e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.462245:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790766.462306:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2349:x1874634236551424:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 207us (2529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790766.462314:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 59 00010000:00010000:0.0:1787790766.462562:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ac18e07/0x70647b5fa9774afb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec12 expref: 7 pid: 8297 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790766.462579:0:8297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8119ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8297:1874634253337216:192.168.201.25@tcp:104: 00010000:00010000:0.0:1787790766.462604:0:8297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f6cfc8fe/0x70647b5fa9774b1e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.462615:0:8297:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f6cfc8fe/0x70647b5fa9774b1e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.462622:0:8297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6cfc8fe/0x70647b5fa9774b1e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.462645:0:8297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f6cfc8fe/0x70647b5fa9774b1e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.462653:0:8297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6cfc8fe/0x70647b5fa9774b1e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.462673:0:8297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6cfc8fe/0x70647b5fa9774b1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.462680:0:8297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981400 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:0.0:1787790766.462684:0:8297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6cfc8fe/0x70647b5fa9774b1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.462694:0:8297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6cfc8fe/0x70647b5fa9774b1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.462706:0:8297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6cfc8fe/0x70647b5fa9774b1e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.462713:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6cfc8fe/0x70647b5fa9774b1e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790766.462802:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2347:x1874634236551296:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 Request processed in 11968us (12203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790766.462809:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:2.0:1787790766.467510:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790766.468378:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236551680 00000100:00100000:0.0:1787790766.468389:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236551680 00000100:00100000:0.0:1787790766.468456:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 127 00000100:00100000:0.0:1787790766.468466:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ee9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+14:10546:x1874634236551680:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787790766.468545:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9774b25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.468576:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9774b25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.468587:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9774b25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.469080:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774b2c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.469094:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774adf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebfd expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.469112:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774b2c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.469147:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774adf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebfd expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.469165:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774adf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebfd expref: 15 pid: 5847 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790766.469188:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8119ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874634253337344:192.168.201.25@tcp:104: 00000100:00100000:0.0:1787790766.469280:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67d4b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787790766.474768:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790766.475026:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8119ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874634253337344:192.168.201.25@tcp:104: 00010000:00010000:0.0:1787790766.475061:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774b2c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790766.478871:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236551808 00000100:00100000:1.0:1787790766.478885:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236551808 00010000:00010000:1.0:1787790766.478939:0:11653:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774adf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebfd expref: 16 pid: 5847 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790766.478981:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:1.0:1787790766.478989:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+16:2348:x1874634236551808:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790766.479003:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790766.479010:0:11653:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774adf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebfd expref: 16 pid: 5847 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.479023:0:11653:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774adf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebfd expref: 16 pid: 5847 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.479044:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774adf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebfd expref: 16 pid: 5847 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.479061:0:11653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff931a49c31600) 00010000:00010000:1.0:1787790766.479066:0:11653:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774b2c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.479074:0:11653:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774b2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.479081:0:11653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774b2c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.479124:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790766.479204:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+15:2348:x1874634236551808:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 215us (4495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790766.479213:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 60 00010000:00010000:2.0:1787790766.479378:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774b2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.479388:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774b2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787790766.479580:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1787790766.479777:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787790766.479827:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1787790766.479934:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53eead00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1874634253337472:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787790766.479993:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790766.480021:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4929c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790766.481968:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253337472 00000100:00100000:1.0:1787790766.481983:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253337472 00000100:00100000:1.0:1787790766.482040:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787790766.482050:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ee8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1874634253337472:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787790766.482178:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ee8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1874634253337472:12345-0@lo:1000:mdt00_000.0 Request processed in 130us (2184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790766.482186:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787790766.482895:0:5846:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787790766.482909:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:2.0:1787790766.482937:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff931a7be3a580, transno 4294967309 00000004:00080000:2.0:1787790766.482963:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff931a7be3a1c0, transno 4294967310 00000100:00100000:2.0:1787790766.482974:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53eead00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1874634253337472:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787790766.483871:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1787790766.483987:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53eead00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1874634253337600:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787790766.484067:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790766.485231:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4929c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790766.493144:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253337600 00000100:00100000:3.0:1787790766.493166:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253337600 00000100:00100000:2.0:1787790766.493391:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787790766.493404:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ee9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874634253337600:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787790766.493795:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ee9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1874634253337600:12345-0@lo:1000:mdt00_000.0 Request processed in 394us (9727us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787790766.493802:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787790766.493919:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53eead00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1874634253337600:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787790766.493988:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774b2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.494000:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774b2c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.494009:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774b2c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.494015:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790766.494020:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774b2c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.494028:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774b2c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.494053:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff931a49c31600) 00010000:00010000:0.0:1787790766.494056:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787790766.494061:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774b2c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.494068:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774b2c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.494107:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774a6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.494114:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774a6f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.494120:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774a6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.494134:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40031400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790766.494138:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774a6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.494144:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774a6f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.494152:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:0.0:1787790766.494155:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787790766.494162:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705000/0x70647b5fa9774a76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebe1 expref: 18 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.494173:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705000/0x70647b5fa9774a76 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebe1 expref: 18 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.494182:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705000/0x70647b5fa9774a76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebe1 expref: 18 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.494216:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705000/0x70647b5fa9774a76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebe1 expref: 18 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790766.494230:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8119ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874634253337728:192.168.201.25@tcp:105: 00000100:00100000:0.0:1787790766.494315:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67d4b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787790766.497854:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8119ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874634253337728:192.168.201.25@tcp:105: 00010000:00010000:0.0:1787790766.497888:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774a6f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.498275:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa9774a6f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.498310:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9774b33 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.498326:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9774b33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.498338:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9774b33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.498348:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9774b33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.498355:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9774b33 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.498363:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9774b33 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.498369:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790766.498373:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9774b33 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.498380:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9774b33 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.498392:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:0.0:1787790766.498395:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790766.498399:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9774b33 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.498413:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9774b33 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.498423:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9774b25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.498429:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9774b25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.498435:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9774b25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.498442:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790766.498445:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9774b25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.498451:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9774b25 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.498462:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:0.0:1787790766.498466:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787790766.498469:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9774b25 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790766.498475:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9774b25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790766.498528:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790766.498778:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ee9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:10546:x1874634236551680:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 30308us (31273us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1787790766.498790:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 127 00000020:00080000:0.0:1787790766.498804:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787790766.498930:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787790766.498936:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787790766.499521:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787790766.499532:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787790766.499668:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236551936 00000100:00100000:1.0:1787790766.499678:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236551936 00000100:00100000:1.0:1787790766.499765:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:1.0:1787790766.499775:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be3a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:10543:x1874634236551936:12345-192.168.201.25@tcp:49:lfs.0 00000100:00100000:1.0:1787790766.499898:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be3a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:10543:x1874634236551936:12345-192.168.201.25@tcp:49:lfs.0 Request processed in 124us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790766.499905:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:3.0:1787790766.508315:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790766.508464:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236552192 00000100:00100000:3.0:1787790766.508476:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236552192 00000100:00100000:1.0:1787790766.508569:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:1.0:1787790766.508584:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a432ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:10546:x1874634236552192:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787790766.510194:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787790766.510277:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1787790766.510329:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00010000:00010000:2.0:1787790766.510332:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774b3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790766.510375:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236552448 00000100:00100000:0.0:1787790766.510383:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236552448 00010000:00010000:2.0:1787790766.510479:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774b3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.510491:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774b3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.510501:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774b3a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.510508:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774b3a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790766.510513:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774b3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790766.510647:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 128 00010000:00010000:2.0:1787790766.510654:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787790766.510657:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:10543:x1874634236552448:12345-192.168.201.25@tcp:58:lfs.0 00000100:00100000:2.0:1787790766.510761:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a432ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:10546:x1874634236552192:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 2181us (2456us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1787790766.510780:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 32 00000020:00080000:2.0:1787790766.510785:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787790766.510802:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790766.510813:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774b3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.510824:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654e200 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790766.510829:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774b3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.510857:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774b3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787790766.510866:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00010000:00010000:1.0:1787790766.510870:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff931a4b7e7700) 00010000:00010000:1.0:1787790766.510875:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787790766.510880:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774b3a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.510887:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774b3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.510907:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790766.510910:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790766.510912:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790766.510923:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+20:10543:x1874634236552448:12345-192.168.201.25@tcp:58:lfs.0 Request processed in 256us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790766.510932:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 128 00000100:00100000:0.0:1787790766.557033:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790766.557147:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236552576 00000100:00100000:1.0:1787790766.557165:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236552576 00000100:00100000:1.0:1787790766.557310:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 129 00000100:00100000:1.0:1787790766.557334:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+20:10548:x1874634236552576:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1787790766.557368:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790766.557398:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774b41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec19 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.557489:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774b48 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.557510:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774b48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.557525:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774b48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.557579:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774b4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.557587:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774b4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.557594:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774b4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.559197:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774b56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.559219:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774a61 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebda expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.559228:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774b56 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.559277:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774a61 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebda expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790766.559296:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774a61 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebda expref: 21 pid: 5846 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790766.559312:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d8ecb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1874634253337856:192.168.201.25@tcp:104: 00000100:00100000:1.0:1787790766.560094:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47a34780 going to sleep for 11 seconds 00000100:00100000:3.0:1787790766.563087:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790766.563647:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236552832 00000100:00100000:2.0:1787790766.563661:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236552832 00000100:00100000:2.0:1787790766.563772:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:2.0:1787790766.563784:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+22:10544:x1874634236552832:12345-192.168.201.25@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787790766.564040:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:10544:x1874634236552832:12345-192.168.201.25@tcp:35:ldlm_bl.0 Request processed in 259us (969us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1787790766.564049:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:1.0:1787790766.564592:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d8ecb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1874634253337856:192.168.201.25@tcp:104: 00010000:00010000:1.0:1787790766.564638:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774b56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790766.567091:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790766.567260:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236552960 00000100:00100000:3.0:1787790766.567269:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236552960 00010000:00010000:3.0:1787790766.567312:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774a61 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebda expref: 23 pid: 5846 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790766.567359:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:3.0:1787790766.567368:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a493cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:2349:x1874634236552960:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790766.567382:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790766.567389:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774a61 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebda expref: 23 pid: 5846 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.567402:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774a61 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebda expref: 23 pid: 5846 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.567453:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030a00/0x70647b5fa9774a61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebda expref: 23 pid: 5846 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.567470:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:3.0:1787790766.567475:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774b56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.567484:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774b56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.567918:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774b56 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.567952:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790766.568069:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a493cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+22:2349:x1874634236552960:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 700us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790766.568077:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 61 00010000:00010000:3.0:1787790766.568235:0:7920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774b56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.568243:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774b56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790766.568283:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787790766.568287:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787790766.568306:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774b56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.568318:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774b56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.568335:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774b48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.568341:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774b48 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.568347:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774b48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.568353:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790766.568357:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774b48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.568365:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774b48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.568376:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:3.0:1787790766.568378:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790766.568382:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774b48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.568389:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774b48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.568400:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774b4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.569356:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774b4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.569369:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774b4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.569385:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790766.569389:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774b4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.569397:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774b4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.569421:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff931a488be200) 00010000:00010000:3.0:1787790766.569425:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790766.569430:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774b4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.569437:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774b4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.569506:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774b41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec19 expref: 22 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.569523:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774b56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec19 expref: 21 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790766.569529:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:3.0:1787790766.569531:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787790766.569533:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45704400, rc 0) 00000100:00100000:3.0:1787790766.569596:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:10548:x1874634236552576:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 12264us (12571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790766.569605:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 129 00010000:00010000:3.0:1787790766.847882:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790767.024018:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790767.024154:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236553088 00000100:00100000:1.0:1787790767.024169:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236553088 00000100:00100000:1.0:1787790767.024284:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 283 00000100:00100000:1.0:1787790767.024297:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45660850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:2349:x1874634236553088:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790767.024418:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45660850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:2349:x1874634236553088:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 125us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790767.024427:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 283 00000100:00100000:3.0:1787790767.030984:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790767.031036:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236553216 00000100:00100000:0.0:1787790767.031048:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236553216 00000100:00080000:3.0:1787790767.031131:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787790767.031144:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:0.0:1787790767.031158:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:2349:x1874634236553216:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790767.031300:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:2349:x1874634236553216:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 145us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790767.031308:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:2.0:1787790767.039432:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790767.039872:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236553344 00000100:00100000:3.0:1787790767.039884:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236553344 00000100:00100000:3.0:1787790767.039971:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 125 00000100:00100000:3.0:1787790767.039984:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81016d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2349:x1874634236553344:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790767.040072:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81016d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2349:x1874634236553344:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 91us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790767.040081:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 125 00000100:00080000:2.0:1787790767.040660:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1787790767.253152:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:3.0:1787790767.253180:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:3.0:1787790767.253189:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1787790767.253198:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000040:00080000:2.0:1787790767.483303:0:12043:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787790767.483317:0:12043:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787790767.483370:0:12043:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787790767.483377:0:12043:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787790767.552835:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787790767.552849:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787790767.552913:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787790767.552921:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787790767.553107:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d8ede00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874634253337984:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787790767.553245:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a47a34600 going to sleep for 11 seconds 00000100:00100000:0.0:1787790767.559055:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790767.559293:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d8ede00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874634253337984:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787790767.559560:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236553472 00000100:00100000:2.0:1787790767.559569:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236553472 00000100:00100000:2.0:1787790767.559651:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 130 00000100:00100000:2.0:1787790767.559663:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81198b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:10560:x1874634236553472:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787790767.559705:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787790767.559854:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81198b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:10560:x1874634236553472:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 193us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790767.559863:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 130 00000100:00080000:2.0:1787790767.559888:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790767.563813:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790767.566833:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236553728 00000100:00100000:0.0:1787790767.566852:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236553728 00000100:00100000:0.0:1787790767.566980:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 131 00000100:00100000:0.0:1787790767.566993:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:10560:x1874634236553728:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787790767.567022:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790767.567049:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9774b5d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec20 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790767.567196:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774b64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790767.567231:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774b64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790767.567248:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774b64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790767.567264:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787790767.567435:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9774b5d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec20 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790767.567460:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774b64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec20 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790767.567470:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:0.0:1787790767.567473:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790767.567478:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67980000, rc 0) 00000100:00100000:0.0:1787790767.570197:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:10560:x1874634236553728:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 3188us (6378us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1787790767.570223:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 131 00000100:00100000:2.0:1787790767.581720:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790767.581864:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790767.581917:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236554112 00000100:00100000:2.0:1787790767.581930:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236554112 00000100:00100000:2.0:1787790767.582010:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 132 00000100:00100000:2.0:1787790767.582022:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:10560:x1874634236554112:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787790767.582138:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774b72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790767.582159:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774b72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790767.582173:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774b72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790767.582414:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774b72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790767.582421:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774b72 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790767.582429:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774b72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790767.582435:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790767.582440:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774b72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790767.582450:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774b72 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790767.582464:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:2.0:1787790767.582477:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787790767.582484:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774b72 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790767.582492:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774b72 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790767.582655:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236553984 00000100:00100000:0.0:1787790767.582660:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236553984 00000100:00100000:0.0:1787790767.582705:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:0.0:1787790767.582713:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81015e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+25:2347:x1874634236553984:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790767.582740:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790767.582758:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774b64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec20 expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790767.582784:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:0.0:1787790767.582788:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790767.582860:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81015e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+24:2347:x1874634236553984:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 148us (6139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790767.582868:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:2.0:1787790767.583234:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:10560:x1874634236554112:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 1214us (1369us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787790767.583244:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 132 00000040:00080000:0.0:1787790767.586478:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787790767.586489:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787790767.587069:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787790767.587090:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787790767.589855:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790767.590045:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236554368 00000100:00100000:3.0:1787790767.590059:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236554368 00000100:00100000:3.0:1787790767.590145:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 34 00000100:00100000:3.0:1787790767.590157:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81016940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:10560:x1874634236554368:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787790767.590490:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81016940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+24:10560:x1874634236554368:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 334us (651us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787790767.590500:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 34 00010000:00010000:1.0:1787790767.875382:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790768.128180:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8119a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253338112:0@lo:400:kworker.0 00000100:00100000:3.0:1787790768.128287:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790768.128347:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253338112 00000100:00100000:2.0:1787790768.128357:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253338112 00000100:00100000:1.0:1787790768.128671:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253338240:0@lo:400:kworker.0 00000100:00100000:2.0:1787790768.128720:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787790768.128762:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45661c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253338112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790768.128774:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790768.130751:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787790768.130771:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81198f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253338368:0@lo:400:kworker.0 00000100:00100000:1.0:1787790768.130855:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790768.130925:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253338240 00000100:00100000:1.0:1787790768.130936:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253338240 00000100:00100000:1.0:1787790768.130992:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253338368 00000100:00100000:1.0:1787790768.130996:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253338368 00000100:00100000:1.0:1787790768.131039:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787790768.131084:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253338240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790768.131152:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253338240:12345-0@lo:400:kworker.0 Request processed in 84us (2378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790768.131160:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787790768.131191:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787790768.131198:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253338368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790768.131228:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253338368:12345-0@lo:400:kworker.0 Request processed in 31us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790768.131234:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:1.0:1787790768.131253:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790768.131297:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81198f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253338368:0@lo:400:kworker.0 00000100:00100000:1.0:1787790768.131314:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253338240:0@lo:400:kworker.0 00000100:00100000:1.0:1787790768.134222:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253338496:0@lo:400:kworker.0 00000100:00100000:1.0:1787790768.134348:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790768.134560:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790768.134569:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81198f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1874634253338624:0@lo:400:kworker.0 00000100:00100000:1.0:1787790768.134602:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790768.134648:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253338496 00000100:00100000:1.0:1787790768.134657:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253338496 00000100:00100000:1.0:1787790768.134767:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787790768.134778:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a79f85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1874634253338496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790768.134839:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a79f85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1874634253338496:12345-0@lo:400:kworker.0 Request processed in 63us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790768.134847:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1787790768.134871:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790768.134925:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253338496:0@lo:400:kworker.0 00000100:00100000:1.0:1787790768.134955:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253338624 00000100:00100000:1.0:1787790768.134959:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253338624 00000100:00100000:1.0:1787790768.134996:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787790768.135003:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a79f85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874634253338624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790768.135049:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a79f85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874634253338624:12345-0@lo:400:kworker.0 Request processed in 47us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790768.135057:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1787790768.135089:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790768.135107:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81198f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1874634253338624:0@lo:400:kworker.0 00000100:00100000:2.0:1787790768.138787:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45661c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253338112:12345-0@lo:400:kworker.0 Request processed in 10013us (10485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790768.138808:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787790768.139062:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8119a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253338112:0@lo:400:kworker.0 00000100:00100000:1.0:1787790768.139220:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8119b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253338752:0@lo:400:kworker.0 00000100:00100000:1.0:1787790768.139295:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790768.140181:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253338752 00000100:00100000:2.0:1787790768.140189:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253338752 00000100:00100000:2.0:1787790768.140260:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787790768.140268:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a79f87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253338752:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787790768.140661:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787790768.144750:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a79f87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253338752:12345-0@lo:400:kworker.0 Request processed in 4444us (5417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790768.144771:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787790768.145129:0:3320:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787790768.145140:0:3320:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:1.0:1787790768.145168:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff931a7be283c0, transno 4294967301 00000004:00080000:1.0:1787790768.145323:0:3320:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1787790768.145341:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff931a7d8ef0c0, transno 4294967304 00000100:00100000:1.0:1787790768.145351:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8119b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253338752:0@lo:400:kworker.0 00000040:00080000:0.0:1787790768.640287:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787790768.640296:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787790768.640327:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787790768.640333:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787790768.895908:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790769.217432:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787790769.217456:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a810170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253338880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787790769.217526:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790769.217597:0:8510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253338880 00000100:00100000:2.0:1787790769.217604:0:8510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253338880 00000100:00100000:2.0:1787790769.217648:0:8510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787790769.217656:0:8510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81014780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1874634253338880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787790769.217691:0:8510:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787790769.217761:0:8510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81014780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1874634253338880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790769.217769:0:8510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787790769.217823:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a810170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253338880:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787790769.283964:0:12094:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787790769.283975:0:12094:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787790769.284024:0:12094:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787790769.284031:0:12094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787790769.429108:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790769.429183:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236554624 00000100:00100000:1.0:1787790769.429193:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236554624 00000100:00100000:1.0:1787790769.429280:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 133 00000100:00100000:1.0:1787790769.429292:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81015a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+24:10581:x1874634236554624:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1787790769.429316:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790769.429336:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774b79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec27 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790769.429449:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa9774b80 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790769.429463:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa9774b80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790769.429475:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa9774b80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790769.429486:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787790769.429606:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704000/0x70647b5fa9774b79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec27 expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790769.429623:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa9774b80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec27 expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790769.429632:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:1.0:1787790769.429635:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787790769.429638:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45705200, rc 0) 00000100:00100000:1.0:1787790769.429692:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81015a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+26:10581:x1874634236554624:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 402us (593us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787790769.429699:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 133 00000100:00080000:2.0:1787790769.429900:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790769.437447:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790769.437530:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236554752 00000100:00100000:3.0:1787790769.437542:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236554752 00000100:00100000:3.0:1787790769.437588:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 134 00000100:00100000:3.0:1787790769.437595:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+26:10581:x1874634236554752:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:3.0:1787790769.437659:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774b8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790769.437674:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774b8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790769.437683:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774b8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790769.437704:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774b8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790769.437709:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774b8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790769.437713:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774b8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790769.437717:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790769.437720:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774b8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790769.437749:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774b8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790769.437756:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:3.0:1787790769.437758:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787790769.437762:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774b8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790769.437773:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774b8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790769.447141:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+26:10581:x1874634236554752:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 9534us (9693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790769.447155:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 134 00000100:00100000:2.0:1787790769.540605:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790769.540706:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236554880 00000100:00100000:1.0:1787790769.540716:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236554880 00000100:00100000:1.0:1787790769.540906:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:1.0:1787790769.540926:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a810170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2346:x1874634236554880:12345-192.168.201.25@tcp:101:cat.0 00000100:00080000:2.0:1787790769.540931:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787790769.540944:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790769.540975:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa9774b95 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec2e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787790769.540996:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f85ad, atime: 0x6a8f85ad, ctime: 0x6a8f85ad, blocks: 0xb 00010000:00010000:1.0:1787790769.541012:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=304s v=(0 0) 00010000:00010000:1.0:1787790769.541015:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790769.541022:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa9774b95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec2e expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790769.541036:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa9774b95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec2e expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790769.541060:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45704000, rc 0) 00000100:00100000:1.0:1787790769.541119:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a810170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2346:x1874634236554880:12345-192.168.201.25@tcp:101:cat.0 Request processed in 196us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790769.541126:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:2.0:1787790769.546814:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790769.546990:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236555008 00000100:00100000:0.0:1787790769.546999:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236555008 00002000:00100000:0.0:1787790769.547150:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff931a7d8ef0c0 x1874634236555008/t0(0) o3->3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp:610/0 lens 488/0 e 0 to 0 dl 1787790780 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787790769.547162:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a7d8ef0c0 with x1874634236555008 ext(0->4095) 00002000:00010000:0.0:1787790769.547168:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff931a7d8ef0c0 00000100:00100000:0.0:1787790769.547236:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:0.0:1787790769.547255:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d8ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2347:x1874634236555008:12345-192.168.201.25@tcp:3:cat.0 00000100:00100000:0.0:1787790769.547620:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d8ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2347:x1874634236555008:12345-192.168.201.25@tcp:3:cat.0 Request processed in 365us (814us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787790769.547628:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 3 00002000:00100000:0.0:1787790769.547635:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff931a7d8ef0c0 x1874634236555008/t0(0) o3->3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp:610/0 lens 488/4536 e 0 to 0 dl 1787790780 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787790769.547643:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a7d8ef0c0 with x1874634236555008 ext(0->4095) 00002000:00010000:0.0:1787790769.547647:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff931a7d8ef0c0 00010000:00010000:1.0:1787790769.924248:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790770.240239:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787790770.240271:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253339008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790770.240371:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790770.243842:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253339008 00000100:00100000:0.0:1787790770.243863:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253339008 00000100:00100000:0.0:1787790770.244137:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787790770.244148:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253339008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787790770.244200:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787790770.244330:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253339008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 183us (3958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790770.244338:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787790770.247466:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253339008:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787790770.248193:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787790770.947820:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787790771.857867:0:11957:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000001:00080000:3.0:1787790771.857887:0:11957:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1787790771.857979:0:11957:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff931a4929c0c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1787790771.857986:0:11957:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff931a465a5100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff931a4929c9c0 00000020:00080000:3.0:1787790771.857990:0:11957:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff931a465a5200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff931a7d73c800 00000020:00080000:0.0:1787790771.858034:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:0.0:1787790771.858350:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1787790771.858399:0:11957:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1787790771.862547:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1787790771.862573:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:1.0:1787790771.967930:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790772.144843:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790772.144886:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790772.144930:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790772.144956:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790772.144982:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790772.145027:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236555520 00000100:00100000:2.0:1787790772.145038:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236555520 00000100:00100000:2.0:1787790772.145114:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236555392 00000100:00100000:2.0:1787790772.145118:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236555392 00000100:00100000:2.0:1787790772.145146:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:2.0:1787790772.145157:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2347:x1874634236555520:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790772.145259:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2347:x1874634236555520:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 104us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790772.145269:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:2.0:1787790772.145289:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:2.0:1787790772.145296:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2347:x1874634236555392:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790772.145322:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2347:x1874634236555392:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 27us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790772.145330:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:2.0:1787790772.145351:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236555136 00000100:00100000:2.0:1787790772.145354:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236555136 00000100:00100000:2.0:1787790772.145383:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 285 00000100:00100000:2.0:1787790772.145390:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45660050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:2347:x1874634236555136:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790772.145417:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45660050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:2347:x1874634236555136:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 28us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790772.145424:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 285 00000100:00100000:2.0:1787790772.145460:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236555264 00000100:00100000:2.0:1787790772.145464:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236555264 00000100:00100000:2.0:1787790772.145496:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236555648 00000100:00100000:2.0:1787790772.145499:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236555648 00000100:00100000:2.0:1787790772.145522:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 129 00000100:00100000:2.0:1787790772.145545:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+13:2347:x1874634236555264:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790772.145587:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+13:2347:x1874634236555264:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 45us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790772.145594:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 129 00000100:00100000:2.0:1787790772.145607:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 130 00000100:00100000:2.0:1787790772.145622:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2347:x1874634236555648:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790772.145649:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2347:x1874634236555648:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 28us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790772.145655:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 130 00000100:00080000:2.0:1787790772.145674:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787790772.145679:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787790772.145681:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787790772.992009:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790773.316100:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a79f84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1874634253339392:0@lo:400:kworker.0 00000100:00100000:1.0:1787790773.316114:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a79f86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253339264:0@lo:400:kworker.0 00000100:00100000:0.0:1787790773.316178:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a79f84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253339520:0@lo:400:kworker.0 00000100:00100000:2.0:1787790773.316370:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a79f861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253339136:0@lo:400:kworker.0 00000100:00100000:3.0:1787790773.316433:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790773.316519:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253339392 00000100:00100000:3.0:1787790773.316527:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253339392 00000100:00100000:3.0:1787790773.316589:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787790773.316608:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874634253339392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790773.316657:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874634253339392:12345-0@lo:400:kworker.0 Request processed in 52us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790773.316664:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1787790773.316686:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790773.316750:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a79f84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1874634253339392:0@lo:400:kworker.0 00000100:00100000:1.0:1787790773.317460:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790773.317499:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a79f84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253339776:0@lo:400:kworker.0 00000100:00100000:1.0:1787790773.317593:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790773.317608:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253339264 00000100:00100000:3.0:1787790773.317614:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253339264 00000100:00100000:1.0:1787790773.317649:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253339776 00000100:00100000:3.0:1787790773.317654:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787790773.317655:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253339776 00000100:00100000:3.0:1787790773.317665:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a79f84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253339264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790773.317703:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787790773.317712:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a79f84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253339264:12345-0@lo:400:kworker.0 Request processed in 49us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790773.317721:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787790773.317743:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a79f852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253339776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790773.317776:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a79f852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253339776:12345-0@lo:400:kworker.0 Request processed in 58us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790773.317782:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1787790773.317805:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790773.317824:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a79f86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253339264:0@lo:400:kworker.0 00000100:00100000:1.0:1787790773.317834:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a79f84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253339776:0@lo:400:kworker.0 00000100:00100000:1.0:1787790773.318395:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790773.318417:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790773.318470:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253339520 00000100:00100000:3.0:1787790773.318475:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253339520 00000100:00100000:2.0:1787790773.318494:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a79f87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253339648:0@lo:400:kworker.0 00000100:00100000:3.0:1787790773.318515:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787790773.318523:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a79f84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253339520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790773.318561:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a79f84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253339520:12345-0@lo:400:kworker.0 Request processed in 39us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790773.318568:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1787790773.318596:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790773.318616:0:3318:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1787790773.318622:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1787790773.318645:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a79f84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253339520:0@lo:400:kworker.0 00000100:00100000:2.0:1787790773.318840:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790773.319014:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253339648 00000100:00100000:3.0:1787790773.319019:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253339648 00000100:00100000:3.0:1787790773.319073:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787790773.319076:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253339136 00000100:00100000:3.0:1787790773.319082:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253339648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790773.319083:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253339136 00000100:00100000:3.0:1787790773.319127:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253339648:12345-0@lo:400:kworker.0 Request processed in 48us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790773.319134:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787790773.319166:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a79f87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253339648:0@lo:400:kworker.0 00000100:00080000:1.0:1787790773.319416:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790773.319522:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787790773.319532:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253339136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790773.319610:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253339136:12345-0@lo:400:kworker.0 Request processed in 80us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790773.321416:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a79f861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253339136:0@lo:400:kworker.0 00000100:00100000:1.0:1787790773.321774:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787790773.966567:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790773.969079:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236555776 00000100:00100000:2.0:1787790773.969090:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236555776 00000100:00100000:2.0:1787790773.969213:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 135 00000100:00100000:2.0:1787790773.969224:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a79f86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+13:10232:x1874634236555776:12345-192.168.201.25@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787790773.969335:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a79f86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+13:10232:x1874634236555776:12345-192.168.201.25@tcp:60:lhsmtool_posix.0 Request processed in 114us (2776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790773.969341:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 135 00000100:00100000:2.0:1787790773.986161:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790773.987564:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236556032 00000100:00100000:3.0:1787790773.987574:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236556032 00000100:00100000:3.0:1787790773.987669:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:3.0:1787790773.987676:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+13:10232:x1874634236556032:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787790773.989255:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+14:10232:x1874634236556032:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 1573us (3095us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787790773.989262:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 35 00010000:00010000:1.0:1787790774.015990:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790774.140872:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790774.141213:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236556160 00000100:00100000:2.0:1787790774.141224:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236556160 00000100:00080000:1.0:1787790774.141354:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790774.141396:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 136 00000100:00100000:2.0:1787790774.141409:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81198f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:11033:x1874634236556160:12345-192.168.201.25@tcp:101:lsof.0 00010000:00010000:2.0:1787790774.141430:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790774.141451:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774b9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec35 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790774.141545:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774ba3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790774.141560:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790774.141573:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790774.141821:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787790774.141825:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787790774.141916:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790774.142081:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774b9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec35 expref: 7 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790774.142098:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec35 expref: 6 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790774.142106:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a49c31300) 00010000:00010000:2.0:1787790774.142109:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790774.142113:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654ec00, rc 0) 00000100:00100000:2.0:1787790774.142173:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81198f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+6:11033:x1874634236556160:12345-192.168.201.25@tcp:101:lsof.0 Request processed in 768us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790774.142180:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 136 00000100:00100000:3.0:1787790774.337004:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5fc861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253339904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790774.337079:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790774.337207:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253339904 00000100:00100000:0.0:1787790774.337215:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253339904 00000100:00100000:0.0:1787790774.337263:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787790774.337272:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be3a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253339904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787790774.337319:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787790774.345711:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be3a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253339904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8431us (8622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790774.345736:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787790774.350094:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5fc861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253339904:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787790775.039882:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790775.360041:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be3a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253340032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790775.360121:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790775.363047:0:8510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253340032 00000100:00100000:2.0:1787790775.363063:0:8510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253340032 00000100:00100000:2.0:1787790775.363176:0:8510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787790775.363186:0:8510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a79f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253340032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787790775.363224:0:8510:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787790775.363313:0:8510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a79f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253340032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (3191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790775.363320:0:8510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787790775.363515:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be3a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253340032:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787790775.363696:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787790776.065015:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787790776.976378:0:11957:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1787790776.976399:0:11957:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1787790776.976466:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787790776.976687:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1787790777.092629:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787790777.097082:0:12297:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 20:32:55 (1787790775) 00000100:00100000:2.0:1787790777.265385:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790777.265421:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790777.265450:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790777.265470:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790777.265495:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790777.265521:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236556800 00000100:00100000:2.0:1787790777.265530:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236556800 00000100:00100000:2.0:1787790777.265585:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236556416 00000100:00100000:2.0:1787790777.265589:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236556416 00000100:00100000:2.0:1787790777.265612:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 134 00000100:00100000:2.0:1787790777.265622:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fed25c-dd19-4a75-a88a-8563aeaeed43+6:2348:x1874634236556800:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790777.265699:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fed25c-dd19-4a75-a88a-8563aeaeed43+6:2348:x1874634236556800:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 78us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790777.265707:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 134 00000100:00100000:2.0:1787790777.265741:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 135 00000100:00100000:2.0:1787790777.265748:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+13:2348:x1874634236556416:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790777.265778:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+13:2348:x1874634236556416:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 30us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790777.265784:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 135 00000100:00100000:3.0:1787790777.266065:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236556288 00000100:00100000:3.0:1787790777.266071:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236556288 00000100:00100000:3.0:1787790777.266112:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 287 00000100:00100000:3.0:1787790777.266119:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+13:2348:x1874634236556288:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790777.266150:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+13:2348:x1874634236556288:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 32us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790777.266157:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 287 00000100:00080000:2.0:1787790777.266784:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790777.266813:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236556544 00000100:00100000:2.0:1787790777.266818:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236556544 00000100:00100000:2.0:1787790777.266860:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236556672 00000100:00100000:2.0:1787790777.266864:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236556672 00000100:00100000:2.0:1787790777.266888:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:2.0:1787790777.266895:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2348:x1874634236556544:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790777.266938:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2348:x1874634236556544:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 44us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790777.266944:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:2.0:1787790777.266957:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:2.0:1787790777.266963:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2348:x1874634236556672:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790777.266988:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2348:x1874634236556672:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 26us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790777.266994:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00080000:3.0:1787790777.267063:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787790777.267066:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787790778.114762:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790778.309264:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790778.309337:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236557056 00000100:00100000:2.0:1787790778.309353:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236557056 00000100:00100000:0.0:1787790778.309507:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 137 00000100:00100000:0.0:1787790778.309519:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+13:11297:x1874634236557056:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787790778.309539:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790778.309559:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774baa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec3c expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.309637:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774bb1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.309651:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.309664:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.309678:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774bb8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.309685:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.309717:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.310107:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774bbf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.310116:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774bbf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.310124:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774bbf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790778.310133:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787790778.310308:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.310317:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774bb1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.310324:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774bb1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.310330:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790778.310334:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774bb1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.310342:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774bb1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.310353:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff931a49c31100) 00010000:00010000:0.0:1787790778.310356:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790778.310365:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774bb1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.310372:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774bb1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.310384:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.310391:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774bb8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.310397:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.310402:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790778.310405:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.310635:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774bb8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.310643:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff931a49c31500) 00010000:00010000:0.0:1787790778.310646:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790778.310649:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774bb8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.310655:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774bb8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.311216:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774baa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec3c expref: 16 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.311243:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774bbf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec3c expref: 15 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790778.311251:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff931a4b7e7200) 00010000:00010000:0.0:1787790778.311254:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790778.311256:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981200, rc 0) 00000100:00100000:0.0:1787790778.311314:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+15:11297:x1874634236557056:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 1798us (2058us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787790778.311323:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 137 00000100:00100000:0.0:1787790778.316188:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790778.316230:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790778.316300:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236557184 00000100:00100000:3.0:1787790778.316311:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236557184 00000100:00100000:1.0:1787790778.316342:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236557312 00000100:00100000:3.0:1787790778.316381:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:3.0:1787790778.316392:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+15:2347:x1874634236557184:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790778.316419:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790778.316457:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774bbf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec3c expref: 15 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790778.316475:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff931a4b7e7200) 00010000:00010000:3.0:1787790778.316480:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790778.316521:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236557312 00000100:00100000:3.0:1787790778.316539:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+15:2347:x1874634236557184:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 149us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790778.316546:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:1.0:1787790778.316551:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 138 00000100:00100000:1.0:1787790778.316558:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+14:11297:x1874634236557312:12345-192.168.201.25@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787790778.316635:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+14:11297:x1874634236557312:12345-192.168.201.25@tcp:59:lhsmtool_posix.0 Request processed in 77us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790778.316642:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 138 00000100:00100000:3.0:1787790778.432558:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be3a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253340160:0@lo:400:kworker.0 00000100:00100000:3.0:1787790778.432636:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790778.432676:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253340160 00000100:00100000:0.0:1787790778.432683:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253340160 00000100:00100000:3.0:1787790778.432684:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be38780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253340672:0@lo:400:kworker.0 00000100:00100000:3.0:1787790778.432742:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790778.432744:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787790778.432753:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45663050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253340160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790778.432802:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45663050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253340160:12345-0@lo:400:kworker.0 Request processed in 50us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790778.432810:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787790778.432845:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253340672 00000100:00100000:0.0:1787790778.432849:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253340672 00000100:00100000:3.0:1787790778.432853:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be3a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253340160:0@lo:400:kworker.0 00000100:00100000:3.0:1787790778.432869:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787790778.432875:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be39a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253340544:0@lo:400:kworker.0 00000100:00100000:3.0:1787790778.433026:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790778.433060:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253340288:0@lo:400:kworker.0 00000100:00100000:3.0:1787790778.433085:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790778.433098:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253340288 00000100:00100000:0.0:1787790778.433102:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253340288 00000100:00100000:0.0:1787790778.433141:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787790778.433148:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253340672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790778.433238:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787790778.433248:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253340288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790778.433288:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253340288:12345-0@lo:400:kworker.0 Request processed in 43us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790778.433296:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787790778.433321:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253340672:12345-0@lo:400:kworker.0 Request processed in 172us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790778.433333:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253340288:0@lo:400:kworker.0 00000100:00100000:0.0:1787790778.433339:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787790778.433342:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253340800:0@lo:400:kworker.0 00000100:00100000:1.0:1787790778.433359:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be38780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253340672:0@lo:400:kworker.0 00000100:00100000:3.0:1787790778.434166:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790778.434207:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790778.434215:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be38b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253340416:0@lo:400:kworker.0 00000100:00100000:3.0:1787790778.434240:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790778.434290:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253340544 00000100:00100000:0.0:1787790778.434290:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253340416 00000100:00100000:0.0:1787790778.434296:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253340416 00000100:00100000:3.0:1787790778.434302:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253340544 00000100:00100000:3.0:1787790778.434327:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253340800 00000100:00100000:3.0:1787790778.434330:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253340800 00000100:00100000:0.0:1787790778.434330:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787790778.434336:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253340416:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787790778.436851:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787790778.436862:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253340416:12345-0@lo:400:kworker.0 Request processed in 2519us (2614us total) trans 0 rc 0/0 00000100:00080000:2.0:1787790778.436863:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787790778.436866:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790778.436875:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787790778.437126:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787790778.437145:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253340544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790778.437223:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253340544:12345-0@lo:400:kworker.0 Request processed in 84us (4193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790778.437223:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787790778.437234:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787790778.437240:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253340800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790778.437297:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be38b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253340416:0@lo:400:kworker.0 00000100:00100000:1.0:1787790778.437297:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253340800:12345-0@lo:400:kworker.0 Request processed in 59us (3130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790778.437310:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787790778.437317:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253340800:0@lo:400:kworker.0 00000100:00100000:1.0:1787790778.439718:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be39a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253340544:0@lo:400:kworker.0 00000040:00080000:3.0:1787790778.882239:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787790778.882249:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787790778.884588:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1787790778.884602:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787790779.136819:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790779.457673:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787790779.457700:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d791a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253340928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787790779.457805:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790779.457909:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253340928 00000100:00100000:0.0:1787790779.457917:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253340928 00000100:00100000:0.0:1787790779.457975:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787790779.457987:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253340928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787790779.458023:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787790779.458074:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253340928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790779.458081:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787790779.458262:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d791a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253340928:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787790780.160113:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790780.160248:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790780.160331:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236557440 00000100:00100000:3.0:1787790780.160345:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236557440 00000100:00080000:2.0:1787790780.160470:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790780.160639:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 139 00000100:00100000:3.0:1787790780.160654:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+14:11340:x1874634236557440:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1787790780.160682:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790780.160719:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa9774bcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec43 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.160834:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774bd4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.160851:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.160888:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.160909:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774bdb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.160917:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774bdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.160924:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774bdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.161260:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.161270:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774bd4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.161277:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774bd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.161284:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790780.161289:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774bd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.161300:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774bd4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.161315:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a49c31300) 00010000:00010000:3.0:1787790780.161323:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790780.161330:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774bd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.161344:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774bd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.161361:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774bdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.161367:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774bdb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.161372:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774bdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.161377:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790780.161380:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774bdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.161386:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774bdb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.161394:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff931a541ad700) 00010000:00010000:3.0:1787790780.161396:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790780.161399:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774bdb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.161405:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774bdb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.161444:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa9774bcd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec43 expref: 15 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.161467:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a49c31300) 00010000:00010000:3.0:1787790780.161469:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790780.161473:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa9774bcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec43 expref: 15 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.161484:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153800, rc 0) 00000100:00100000:3.0:1787790780.161570:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+14:11340:x1874634236557440:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 921us (1329us total) trans 0 rc 301/301 00000100:00100000:3.0:1787790780.161579:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 139 00000100:00100000:2.0:1787790780.175432:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790780.175530:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236557696 00000100:00100000:1.0:1787790780.175545:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236557696 00000100:00100000:1.0:1787790780.175624:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 140 00000100:00100000:1.0:1787790780.175637:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+14:11340:x1874634236557696:12345-192.168.201.25@tcp:36:lfs.0 00010000:00010000:1.0:1787790780.175779:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790780.175815:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977454b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea7c expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.175840:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a49c31300) 00010000:00010000:1.0:1787790780.175847:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790780.176200:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774be2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.176221:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774ba3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec35 expref: 5 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.176233:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774be2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.176277:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec35 expref: 5 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.176294:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774ba3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec35 expref: 5 pid: 7920 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790780.176313:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a79f870c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874634253341056:192.168.201.25@tcp:104: 00000100:00100000:1.0:1787790780.176444:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82780 going to sleep for 11 seconds 00000100:00100000:2.0:1787790780.183255:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790780.183349:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236557824 00000100:00100000:3.0:1787790780.183364:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236557824 00010000:00010000:3.0:1787790780.183588:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774ba3 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec35 expref: 6 pid: 7920 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787790780.183597:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790780.183636:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 62 00000100:00100000:3.0:1787790780.183650:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+6:2349:x1874634236557824:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790780.183667:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790780.183674:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774ba3 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec35 expref: 6 pid: 7920 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.183689:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774ba3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec35 expref: 6 pid: 7920 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.183713:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a49c31300) 00010000:00010000:3.0:1787790780.183718:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774be2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.183777:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774be2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.183785:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774be2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.183806:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790780.183873:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+6:2349:x1874634236557824:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 226us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790780.183881:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 62 00010000:00010000:0.0:1787790780.189067:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774ba3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec35 expref: 5 pid: 7920 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790780.189101:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a79f870c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874634253341056:192.168.201.25@tcp:104: 00010000:00010000:0.0:1787790780.189143:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774be2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.193073:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774be2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.193095:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774be2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.193153:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774be9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.193171:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774be9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.193186:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774be9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790780.204955:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787790780.204994:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774be2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.205007:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774be2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.205017:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774be2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.205024:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790780.205030:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774be2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.205039:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774be2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.205064:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a49c31300) 00010000:00010000:1.0:1787790780.205068:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790780.205074:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774be2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.205098:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774be2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790780.205132:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000560dd2cb reply state 000000003f9224da transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774be9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790780.205144:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787790780.205288:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+15:11340:x1874634236557696:12345-192.168.201.25@tcp:36:lfs.0 Request processed in 29648us (29866us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1787790780.205300:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 140 00010000:00010000:2.0:1787790780.210644:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774be9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.210685:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774be9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.210694:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774be9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.210701:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790780.210715:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774be9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.210793:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774be9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.210818:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff931a488bec00) 00010000:00010000:2.0:1787790780.210822:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790780.210828:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774be9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.210836:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774be9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790780.279062:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790780.280136:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236557952 00000100:00100000:1.0:1787790780.280154:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236557952 00000100:00100000:1.0:1787790780.280313:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 141 00000100:00100000:1.0:1787790780.280327:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+14:11348:x1874634236557952:12345-192.168.201.25@tcp:101:lctl.0 00010000:00010000:1.0:1787790780.280363:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790780.280395:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774bf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec4a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.280493:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774bf7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.280511:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.280526:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790780.280613:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787790780.280617:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787790780.280688:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.280781:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774bf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec4a expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.280809:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec4a expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.280820:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a488be200) 00010000:00010000:1.0:1787790780.280824:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787790780.280829:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45704e00, rc 0) 00000100:00100000:2.0:1787790780.284246:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+15:11348:x1874634236557952:12345-192.168.201.25@tcp:101:lctl.0 Request processed in 3906us (5185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790780.284262:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 141 00000100:00100000:2.0:1787790780.355063:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790780.355194:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236558080 00000100:00100000:1.0:1787790780.355207:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236558080 00000100:00100000:1.0:1787790780.355289:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 142 00000100:00100000:1.0:1787790780.355302:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+15:11354:x1874634236558080:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1787790780.355334:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790780.355377:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774bfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec51 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.355467:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774c05 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.355485:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774c05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.355498:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774c05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.355515:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774c0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.355541:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774c0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.355548:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774c0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.359582:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980400/0x70647b5fa9774c13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.359638:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980400/0x70647b5fa9774c13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.359656:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980400/0x70647b5fa9774c13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790780.359792:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787790780.359797:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787790780.359829:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980400/0x70647b5fa9774c13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.359845:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774c05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.359852:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774c05 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.359868:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774c05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.359875:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790780.359880:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774c05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.359889:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774c05 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.359904:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a488be200) 00010000:00010000:0.0:1787790780.359907:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790780.359912:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774c05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.359929:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774c05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.359950:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774c0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.359957:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774c0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.359963:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774c0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.359968:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790780.359971:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774c0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.359977:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774c0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.359985:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff931a488be900) 00010000:00010000:0.0:1787790780.359988:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790780.359991:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774c0c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.359997:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774c0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.360053:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774bfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec51 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.360071:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980400/0x70647b5fa9774c13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec51 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.360086:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:0.0:1787790780.360088:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787790780.360091:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67980400, rc 0) 00000100:00100000:0.0:1787790780.360192:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+16:11354:x1874634236558080:12345-192.168.201.25@tcp:101:bash.0 Request processed in 4892us (5144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790780.360202:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 142 00000100:00100000:1.0:1787790780.367504:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790780.367867:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236558336 00000100:00100000:3.0:1787790780.367878:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236558336 00000100:00100000:3.0:1787790780.367946:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 143 00000100:00100000:3.0:1787790780.367955:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a79f843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+16:11354:x1874634236558336:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1787790780.367975:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790780.367996:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa9774c1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec58 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.368152:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.368168:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.368181:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.368245:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774c28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.368272:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774c28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.368280:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774c28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787790780.368972:0:7920:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787790780.369139:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774c2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.369150:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.369159:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.369196:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.369205:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c21 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.369212:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.369219:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790780.369224:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.369231:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.369255:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:3.0:1787790780.369258:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790780.369263:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c21 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.369270:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787790780.369283:0:7920:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a03c6c42 reply state 000000009ed6acb9 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774c28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790780.369291:0:7920:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787790780.369322:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa9774c1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec58 expref: 19 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.369335:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774c2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec58 expref: 18 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.369343:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a541ad600) 00010000:00010000:3.0:1787790780.369345:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787790780.369348:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82152c00, rc 0) 00000100:00100000:3.0:1787790780.369425:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a79f843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+19:11354:x1874634236558336:12345-192.168.201.25@tcp:101:bash.0 Request processed in 1468us (1930us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1787790780.369435:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 143 00010000:00010000:3.0:1787790780.373976:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774c28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.373995:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774c28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.374021:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774c28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.374028:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790780.374032:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774c28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.374041:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774c28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.374059:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff931a541ad700) 00010000:00010000:3.0:1787790780.374062:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790780.374068:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774c28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.374075:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa9774c28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790780.378891:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790780.378976:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236558464 00000100:00100000:3.0:1787790780.378986:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236558464 00000100:00100000:3.0:1787790780.379053:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:3.0:1787790780.379062:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a79f85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2348:x1874634236558464:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1787790780.379081:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790780.379102:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000432da251/0x70647b5fa9774c3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec5f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787790780.379142:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787790780.379162:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=315s v=(0 0) 00010000:00010000:3.0:1787790780.379180:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790780.379191:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000432da251/0x70647b5fa9774c3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec5f expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.379212:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000432da251/0x70647b5fa9774c3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec5f expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.379225:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153800, rc 0) 00000100:00100000:3.0:1787790780.379290:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a79f85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2348:x1874634236558464:12345-192.168.201.25@tcp:101:bash.0 Request processed in 229us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790780.379297:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00080000:2.0:1787790780.380676:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787790780.385151:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790780.385229:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236558592 00000100:00100000:3.0:1787790780.385239:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236558592 00000100:00100000:3.0:1787790780.385294:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:3.0:1787790780.385304:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:11354:x1874634236558592:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1787790780.385321:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790780.385350:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa9774c44 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec66 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.385380:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000432da251/0x70647b5fa9774c3d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec5f expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.385389:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790780.385394:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790780.385399:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa9774c44 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec66 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.385461:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000432da251/0x70647b5fa9774c3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec5f expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.385475:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000432da251/0x70647b5fa9774c3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec5f expref: 7 pid: 6685 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790780.385490:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a679c30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6683:1874634253341184:192.168.201.25@tcp:104: 00000100:00100000:3.0:1787790780.385587:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a492ade40 going to sleep for 11 seconds 00000100:00100000:0.0:1787790780.389053:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790780.389172:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236558720 00000100:00100000:1.0:1787790780.389189:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236558720 00000100:00100000:3.0:1787790780.389214:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a679c30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6683:1874634253341184:192.168.201.25@tcp:104: 00010000:00010000:1.0:1787790780.389246:0:8498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000432da251/0x70647b5fa9774c3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec5f expref: 8 pid: 6685 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.389265:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa9774c44 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec66 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.389291:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153a00, rc 0) 00000100:00100000:1.0:1787790780.389307:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:1.0:1787790780.389337:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d791a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2348:x1874634236558720:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790780.389355:0:8498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790780.389380:0:8498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000432da251/0x70647b5fa9774c3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec5f expref: 8 pid: 6685 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790780.389384:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:11354:x1874634236558592:12345-192.168.201.25@tcp:101:bash.0 Request processed in 4079us (4240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790780.389411:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 48 00010000:00010000:1.0:1787790780.389427:0:8498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000432da251/0x70647b5fa9774c3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec5f expref: 8 pid: 6685 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.389458:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000432da251/0x70647b5fa9774c3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec5f expref: 7 pid: 6685 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.389477:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790780.389497:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790780.389507:0:8498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa9774c44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec66 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.389518:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa9774c44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec66 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.389561:0:8498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa9774c44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec66 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790780.389576:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a79f870c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8498:1874634253341312:192.168.201.25@tcp:105: 00000100:00100000:1.0:1787790780.389690:0:8498:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82180 going to sleep for 11 seconds 00000100:00100000:1.0:1787790780.392950:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a79f870c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8498:1874634253341312:192.168.201.25@tcp:105: 00010000:00010000:1.0:1787790780.392985:0:8498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790780.393062:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d791a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2348:x1874634236558720:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 3744us (4024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790780.393074:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:0.0:1787790780.397614:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790780.397760:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236558976 00000100:00100000:3.0:1787790780.397774:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236558976 00000100:00100000:3.0:1787790780.397906:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:3.0:1787790780.397919:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d790780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:11354:x1874634236558976:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:3.0:1787790780.400086:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d790780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+19:11354:x1874634236558976:12345-192.168.201.25@tcp:35:bash.0 Request processed in 2158us (2476us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1787790780.400104:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:0.0:1787790780.480230:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a679c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253341440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790780.480333:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790780.480556:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253341440 00000100:00100000:2.0:1787790780.480594:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253341440 00000100:00080000:3.0:1787790780.480667:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787790780.480692:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787790780.480713:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253341440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787790780.480789:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787790780.480868:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253341440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790780.480876:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787790780.481284:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a679c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253341440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790780.481801:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790780.482140:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236559232 00000100:00100000:2.0:1787790780.482150:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236559232 00000100:00100000:2.0:1787790780.482211:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 144 00000100:00100000:2.0:1787790780.482221:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+19:11364:x1874634236559232:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1787790780.482244:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790780.482265:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774c4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec6d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790780.482388:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787790780.482695:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774c4b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec6d expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.482708:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a488be200) 00010000:00010000:2.0:1787790780.482711:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787790780.482715:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774c4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec6d expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.482744:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654f600, rc 0) 00000100:00100000:2.0:1787790780.482841:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+20:11364:x1874634236559232:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 621us (1050us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1787790780.482872:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 144 00000100:00100000:1.0:1787790780.487132:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790780.487715:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236559488 00000100:00100000:2.0:1787790780.488053:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236559488 00000100:00100000:2.0:1787790780.488153:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00100000:2.0:1787790780.488164:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a79f870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+20:11364:x1874634236559488:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1787790780.488476:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a79f870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:11364:x1874634236559488:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 314us (1354us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1787790780.488484:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00100000:0.0:1787790780.567652:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790780.567758:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236559616 00000100:00100000:1.0:1787790780.567767:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236559616 00000100:00100000:1.0:1787790780.567822:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 145 00000100:00100000:1.0:1787790780.567832:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:11370:x1874634236559616:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1787790780.567878:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790780.567899:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9774c59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec74 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.567991:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774c60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.568004:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774c60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.568016:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774c60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790780.568073:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787790780.568076:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787790780.568095:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774c60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.568120:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9774c59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec74 expref: 23 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.568323:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774c60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec74 expref: 22 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.568331:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:1.0:1787790780.568334:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787790780.568338:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45705600, rc 0) 00000100:00100000:1.0:1787790780.568403:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+22:11370:x1874634236559616:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 572us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790780.568411:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 145 00000100:00100000:0.0:1787790780.572380:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790780.572542:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236559872 00000100:00100000:2.0:1787790780.572552:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236559872 00000100:00100000:2.0:1787790780.572611:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 146 00000100:00100000:2.0:1787790780.572621:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+22:11370:x1874634236559872:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1787790780.572642:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790780.572663:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774c67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec7b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.572793:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774c6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.572806:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.572817:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790780.572826:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787790780.572960:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774c67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec7b expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.572995:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774c6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec7b expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.573003:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a541ad600) 00010000:00010000:2.0:1787790780.573006:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790780.573010:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654f400, rc 0) 00000100:00100000:2.0:1787790780.573069:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+24:11370:x1874634236559872:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 450us (700us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1787790780.573077:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 146 00000100:00100000:0.0:1787790780.576973:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790780.577028:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790780.577133:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236560256 00000100:00100000:2.0:1787790780.577142:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236560256 00000100:00100000:2.0:1787790780.577213:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:2.0:1787790780.577223:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813de580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+24:2346:x1874634236560256:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790780.577242:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790780.577268:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774c6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec7b expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.577289:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a541ad600) 00010000:00010000:2.0:1787790780.577294:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790780.577361:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813de580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:2346:x1874634236560256:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 140us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790780.577369:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:1.0:1787790780.578948:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236560128 00000100:00100000:1.0:1787790780.578960:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236560128 00000100:00100000:1.0:1787790780.579037:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 147 00000100:00100000:1.0:1787790780.579046:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:11370:x1874634236560128:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1787790780.579070:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790780.579091:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9774c7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec82 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.579188:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774c83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.579202:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774c83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.579214:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774c83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790780.579228:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787790780.579681:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9774c7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec82 expref: 26 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.579700:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774c83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec82 expref: 25 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.579708:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a541ad600) 00010000:00010000:1.0:1787790780.579711:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787790780.579715:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45704c00, rc 0) 00000100:00100000:1.0:1787790780.579798:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+25:11370:x1874634236560128:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 753us (2768us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1787790780.579806:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 147 00000100:00100000:2.0:1787790780.586847:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790780.587022:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236560384 00000100:00100000:3.0:1787790780.587033:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236560384 00000100:00100000:3.0:1787790780.587098:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:3.0:1787790780.587109:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2349:x1874634236560384:12345-192.168.201.25@tcp:1:lfs.0 00010000:00010000:3.0:1787790780.587157:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774c91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.587176:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa9774c44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec66 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.587185:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790780.587190:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787790780.587194:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774c91 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.587234:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa9774c44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec66 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.587248:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa9774c44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec66 expref: 6 pid: 6683 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790780.587264:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a679c30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1874634253341568:192.168.201.25@tcp:104: 00000100:00100000:3.0:1787790780.587361:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a492ade40 going to sleep for 11 seconds 00000100:00100000:0.0:1787790780.590659:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790780.590758:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236560512 00000100:00100000:2.0:1787790780.590768:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236560512 00002000:00100000:2.0:1787790780.590826:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff931a7db47c00 x1874634236560512/t0(0) o4->3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp:621/0 lens 504/0 e 0 to 0 dl 1787790791 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787790780.590838:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a7db47c00 with x1874634236560512 ext(0->12) 00010000:00010000:2.0:1787790780.590847:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa9774c44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec66 expref: 7 pid: 6683 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.590873:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa9774c44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec66 expref: 7 pid: 6683 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787790780.590880:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff931a7db47c00 00000100:00100000:2.0:1787790780.590900:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:2.0:1787790780.590908:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2348:x1874634236560512:12345-192.168.201.25@tcp:4:lfs.0 00000100:00100000:2.0:1787790780.591334:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:2348:x1874634236560512:12345-192.168.201.25@tcp:4:lfs.0 Request processed in 425us (683us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787790780.591343:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 2 00002000:00100000:2.0:1787790780.591349:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff931a7db47c00 x1874634236560512/t4294967305(0) o4->3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp:621/0 lens 504/448 e 0 to 0 dl 1787790791 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787790780.591358:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a7db47c00 with x1874634236560512 ext(0->12) 00010000:00010000:2.0:1787790780.591363:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa9774c44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec66 expref: 9 pid: 6683 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.591374:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa9774c44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec66 expref: 9 pid: 6683 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787790780.591382:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff931a7db47c00 00000100:00100000:3.0:1787790780.591629:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a679c30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1874634253341568:192.168.201.25@tcp:104: 00010000:00010000:3.0:1787790780.591657:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774c91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790780.595199:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790780.595289:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236560640 00000100:00100000:3.0:1787790780.595301:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236560640 00010000:00010000:3.0:1787790780.595359:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa9774c44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec66 expref: 9 pid: 6683 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790780.595591:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:3.0:1787790780.595603:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db46d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:2348:x1874634236560640:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790780.595622:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787790780.595645:0:5831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787790780.595649:0:5831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787790780 00002000:00010000:3.0:1787790780.595652:0:5831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787790780 00002000:00010000:3.0:1787790780.595655:0:5831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787790780 00010000:00010000:3.0:1787790780.595661:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa9774c44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec66 expref: 9 pid: 6683 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.595676:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa9774c44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec66 expref: 9 pid: 6683 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.595699:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa9774c44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec66 expref: 9 pid: 6683 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.595719:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787790780.595790:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787790780.595814:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774c91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.595825:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774c91 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.595862:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790780.595921:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db46d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2348:x1874634236560640:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 320us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790780.595929:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 64 00010000:00010000:0.0:1787790780.596339:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774c91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.596352:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774c91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.596381:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774c91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.596402:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774c91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.596411:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774c91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.596429:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153e00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:0.0:1787790780.596433:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774c91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.596441:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774c91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.596455:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774c91 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.596464:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e6ae6a2/0x70647b5fa9774c91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790780.596520:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2349:x1874634236560384:12345-192.168.201.25@tcp:1:lfs.0 Request processed in 9413us (9685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790780.596529:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:1.0:1787790780.600792:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790780.600959:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236560896 00000100:00100000:3.0:1787790780.600969:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236560896 00000100:00100000:3.0:1787790780.601028:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:3.0:1787790780.601038:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a432efc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+25:11370:x1874634236560896:12345-192.168.201.25@tcp:35:lfs.0 00000004:00010000:3.0:1787790780.601098:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774c83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec82 expref: 25 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787790780.601583:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1787790780.601628:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1787790780.602206:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1787790780.602263:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c98 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.602281:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774c2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec58 expref: 29 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.602291:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c98 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.602489:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774c2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec58 expref: 29 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.602506:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774c2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec58 expref: 29 pid: 7920 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790780.602521:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a679c30c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874634253341696:192.168.201.25@tcp:104: 00000100:00100000:3.0:1787790780.602687:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a492ade40 going to sleep for 11 seconds 00000100:00100000:0.0:1787790780.607196:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790780.607285:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236561024 00000100:00100000:1.0:1787790780.607296:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236561024 00010000:00010000:1.0:1787790780.607352:0:8498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774c2f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec58 expref: 30 pid: 7920 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790780.607396:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 65 00000100:00100000:1.0:1787790780.607406:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a493cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+30:2349:x1874634236561024:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790780.607422:0:8498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790780.607429:0:8498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774c2f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec58 expref: 30 pid: 7920 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.607442:0:8498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774c2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec58 expref: 30 pid: 7920 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.607468:0:8498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a541ad600) 00010000:00010000:1.0:1787790780.607473:0:8498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c98 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.607483:0:8498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.607490:0:8498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c98 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.607509:0:8498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790780.607572:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a493cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+30:2349:x1874634236561024:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 167us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790780.607580:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 65 00010000:00010000:3.0:1787790780.608830:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774c2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec58 expref: 29 pid: 7920 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790780.608863:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a679c30c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874634253341696:192.168.201.25@tcp:104: 00010000:00010000:3.0:1787790780.608888:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.608898:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.608903:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787790780.609034:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1787790780.609228:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1787790780.609456:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a679c30c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874634253341824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787790780.609513:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790780.609608:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a492ad840 going to sleep for 11 seconds 00000100:00100000:1.0:1787790780.609659:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253341824 00000100:00100000:1.0:1787790780.609679:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253341824 00000100:00100000:1.0:1787790780.609808:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787790780.609817:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1874634253341824:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787790780.609904:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1874634253341824:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 87us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790780.609911:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787790780.610032:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a679c30c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874634253341824:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787790780.610490:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1787790780.610546:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a679c30c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874634253341952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787790780.610575:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790780.611006:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a492ade40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790780.611066:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253341952 00000100:00100000:2.0:1787790780.611071:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253341952 00000100:00100000:2.0:1787790780.611103:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787790780.611109:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874634253341952:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787790780.611300:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1874634253341952:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 190us (723us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787790780.611307:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787790780.611531:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a679c30c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874634253341952:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787790780.611582:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1787790780.611620:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.611629:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c98 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.611637:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c98 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.611642:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790780.611646:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c98 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.611654:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c98 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.611669:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a541ad600) 00010000:00010000:3.0:1787790780.611672:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787790780.611677:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c98 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.611683:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774c98 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787790780.611947:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787790780.612060:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1787790780.612071:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 315492346765ns, next at 316492344310ns, rc = 0 00000001:00080000:3.0:1787790780.612078:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1787790780.612108:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a541ad600) 00010000:00010000:3.0:1787790780.612111:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787790780.612118:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774c83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec82 expref: 33 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790780.612258:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a432efc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+32:11370:x1874634236560896:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 11220us (11473us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1787790780.612267:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 38 00000020:00080000:3.0:1787790780.612271:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787790780.618996:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790780.619194:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236561152 00000100:00100000:2.0:1787790780.619205:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236561152 00000100:00100000:2.0:1787790780.619271:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 148 00000100:00100000:2.0:1787790780.619282:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+32:11370:x1874634236561152:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1787790780.619318:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790780.619462:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774c9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec89 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.619534:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774c9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec89 expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.619549:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774c9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec89 expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.619569:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:2.0:1787790780.619573:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787790780.619577:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654f400, rc 0) 00000100:00100000:2.0:1787790780.619682:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+33:11370:x1874634236561152:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 402us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790780.619689:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 148 00000100:00100000:0.0:1787790780.623700:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790780.623904:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236561408 00000100:00100000:2.0:1787790780.623914:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236561408 00000100:00100000:2.0:1787790780.623970:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:2.0:1787790780.623980:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+33:11370:x1874634236561408:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1787790780.624254:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+34:11370:x1874634236561408:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 274us (563us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1787790780.624262:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:0.0:1787790780.712636:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790780.712704:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236561664 00000100:00100000:3.0:1787790780.712714:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236561664 00000100:00100000:3.0:1787790780.712874:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 149 00000100:00100000:3.0:1787790780.712884:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+34:11380:x1874634236561664:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1787790780.712912:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790780.712936:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774ca6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec90 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790780.713067:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787790780.713199:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774ca6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec90 expref: 36 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.713214:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a488be200) 00010000:00010000:3.0:1787790780.713217:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787790780.713222:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774ca6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec90 expref: 36 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790780.713255:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153a00, rc 0) 00000100:00100000:3.0:1787790780.713310:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+35:11380:x1874634236561664:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 427us (695us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1787790780.713861:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 149 00000100:00100000:0.0:1787790780.718877:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790780.718974:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236561792 00000100:00100000:1.0:1787790780.718984:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236561792 00000100:00100000:1.0:1787790780.719100:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 150 00000100:00100000:1.0:1787790780.719111:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+35:11380:x1874634236561792:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:1.0:1787790780.719186:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774cb4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719202:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774cb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719213:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774cb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719229:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774cbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719236:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719243:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719358:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9774cc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719385:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9774cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719392:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9774cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790780.719443:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9774cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719456:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774cb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719462:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774cb4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719469:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774cb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719476:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790780.719480:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774cb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719487:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774cb4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719498:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:1.0:1787790780.719501:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790780.719506:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774cb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719511:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774cb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719531:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719536:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774cbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719541:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774cbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719546:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790780.719548:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774cbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719554:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774cbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719561:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff931a488be600) 00010000:00010000:1.0:1787790780.719564:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790780.719567:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774cbb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719572:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774cbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719586:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9774cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719591:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9774cc2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719596:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9774cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719607:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790780.719610:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9774cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719617:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9774cc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719624:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:1.0:1787790780.719627:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790780.719630:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9774cc2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.719635:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9774cc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790780.719710:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+35:11380:x1874634236561792:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 600us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790780.719719:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 150 00000100:00100000:0.0:1787790780.722493:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790780.722622:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236562048 00000100:00100000:3.0:1787790780.722632:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236562048 00000100:00100000:3.0:1787790780.722690:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:3.0:1787790780.722699:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c26b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+35:11380:x1874634236562048:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1787790780.722998:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c26b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+36:11380:x1874634236562048:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 298us (511us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1787790780.723006:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:0.0:1787790780.760635:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790780.760829:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236562304 00000100:00100000:1.0:1787790780.760839:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236562304 00000100:00100000:1.0:1787790780.760913:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 151 00000100:00100000:1.0:1787790780.760923:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c269680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+36:11383:x1874634236562304:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1787790780.760948:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790780.760970:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9774cc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec97 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761045:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774cd0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761079:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774cd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761090:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774cd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761107:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774cd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761114:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761120:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761267:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774cde lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761276:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774cde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761284:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774cde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790780.761295:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787790780.761647:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774cd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761657:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774cd0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761663:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774cd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761676:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790780.761680:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774cd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761688:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774cd0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761701:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:1.0:1787790780.761704:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790780.761708:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774cd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761715:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa9774cd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761781:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761788:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774cd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761794:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761799:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790780.761802:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761808:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774cd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761828:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff931a488be600) 00010000:00010000:1.0:1787790780.761830:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790780.761834:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774cd7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761840:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa9774cd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761896:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9774cc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec97 expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761911:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774cde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec97 expref: 38 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.761918:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:1.0:1787790780.761920:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787790780.761922:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41479e00, rc 0) 00000100:00100000:1.0:1787790780.761994:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c269680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+38:11383:x1874634236562304:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1073us (1369us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1787790780.762003:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 151 00000100:00100000:0.0:1787790780.766472:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790780.766824:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236562432 00000100:00100000:2.0:1787790780.766834:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236562432 00000100:00100000:2.0:1787790780.766901:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 152 00000100:00100000:2.0:1787790780.766911:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+38:11383:x1874634236562432:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:2.0:1787790780.766978:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774cec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.766994:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.767006:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.767030:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.767036:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774cec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.767043:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774cec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.767048:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790780.767064:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774cec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.767072:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774cec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.767083:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:2.0:1787790780.767086:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787790780.767090:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774cec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.767096:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774cec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790780.767173:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+38:11383:x1874634236562432:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 263us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790780.767181:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 152 00000100:00100000:0.0:1787790780.770300:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790780.770530:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236562688 00000100:00100000:3.0:1787790780.770540:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236562688 00000100:00100000:3.0:1787790780.770592:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 41 00000100:00100000:3.0:1787790780.770601:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+38:11383:x1874634236562688:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1787790780.770872:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+39:11383:x1874634236562688:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 271us (582us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787790780.770880:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 41 00000100:00100000:0.0:1787790781.000870:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790781.000969:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236562944 00000100:00100000:3.0:1787790781.000978:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236562944 00000100:00100000:3.0:1787790781.001046:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 153 00000100:00100000:3.0:1787790781.001058:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+39:11414:x1874634236562944:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:3.0:1787790781.001085:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790781.001110:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774cf3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ec9e expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.001229:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774cfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.001244:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774cfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.001255:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774cfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790781.001266:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787790781.001422:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774cf3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec9e expref: 42 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.001442:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774cfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec9e expref: 41 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.001451:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:3.0:1787790781.001455:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787790781.001459:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82152c00, rc 0) 00000100:00100000:3.0:1787790781.001526:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+41:11414:x1874634236562944:12345-192.168.201.25@tcp:101:cat.0 Request processed in 471us (678us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1787790781.001534:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 153 00000100:00100000:1.0:1787790781.006184:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790781.006258:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236563200 00000100:00100000:3.0:1787790781.006268:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236563200 00000100:00100000:3.0:1787790781.006334:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:3.0:1787790781.006345:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a79f86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+41:11414:x1874634236563200:12345-192.168.201.25@tcp:35:cat.0 00000100:00100000:3.0:1787790781.006604:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a79f86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+42:11414:x1874634236563200:12345-192.168.201.25@tcp:35:cat.0 Request processed in 259us (428us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787790781.006628:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:0.0:1787790781.014167:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790781.014249:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236563328 00000100:00100000:3.0:1787790781.014260:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236563328 00000100:00100000:3.0:1787790781.014341:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:3.0:1787790781.014352:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+42:2347:x1874634236563328:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790781.014376:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790781.014404:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774cfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec9e expref: 42 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.014646:0:11653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:3.0:1787790781.014652:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790781.014708:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+41:2347:x1874634236563328:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 357us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790781.014716:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:1.0:1787790781.075823:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790781.075938:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236563584 00000100:00100000:2.0:1787790781.075949:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236563584 00000100:00100000:2.0:1787790781.076013:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 154 00000100:00100000:2.0:1787790781.076024:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a79f86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+41:11420:x1874634236563584:12345-192.168.201.25@tcp:101:dd.0 00010000:00010000:2.0:1787790781.076050:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790781.076053:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787790781.076080:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705600/0x70647b5fa9774c60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec74 expref: 41 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.076099:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:2.0:1787790781.076105:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790781.076119:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774d08 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eca5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.076237:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d0f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.076252:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774cde lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec97 expref: 41 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.076261:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d0f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.076294:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774cde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec97 expref: 41 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.076308:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774cde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec97 expref: 41 pid: 5848 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790781.076336:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5fc87840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874634253342080:192.168.201.25@tcp:104: 00000100:00100000:2.0:1787790781.076442:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67cd1180 going to sleep for 11 seconds 00000100:00100000:2.0:1787790781.080161:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5fc87840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874634253342080:192.168.201.25@tcp:104: 00010000:00010000:2.0:1787790781.080196:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d0f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790781.082596:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790781.082936:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236563712 00000100:00100000:3.0:1787790781.082947:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236563712 00010000:00010000:3.0:1787790781.082994:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774cde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec97 expref: 42 pid: 5848 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790781.083036:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 66 00000100:00100000:3.0:1787790781.083046:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a79f84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+42:2348:x1874634236563712:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790781.083063:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790781.083069:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774cde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec97 expref: 42 pid: 5848 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.083082:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774cde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec97 expref: 42 pid: 5848 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.083119:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774cde lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec97 expref: 42 pid: 5848 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.083136:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:3.0:1787790781.083141:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d0f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.083151:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.083158:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d0f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.083192:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790781.083255:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a79f84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+41:2348:x1874634236563712:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 211us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790781.083263:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 66 00010000:00010000:2.0:1787790781.083343:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.083352:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790781.083372:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787790781.083560:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774d08 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eca5 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.083574:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eca5 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.083581:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:2.0:1787790781.083584:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787790781.083586:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654f200, rc 0) 00000100:00100000:2.0:1787790781.083614:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a79f86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+41:11420:x1874634236563584:12345-192.168.201.25@tcp:101:dd.0 Request processed in 7592us (7802us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787790781.083621:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 154 00000100:00100000:1.0:1787790781.087330:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790781.087422:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236563968 00000100:00100000:3.0:1787790781.087432:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236563968 00000100:00100000:3.0:1787790781.087492:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 155 00000100:00100000:3.0:1787790781.087501:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a79f861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+41:11420:x1874634236563968:12345-192.168.201.25@tcp:36:dd.0 00010000:00010000:3.0:1787790781.087990:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774d1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.088010:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.088021:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787790781.088086:0:7920:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1787790781.088111:0:7920:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087bd6870 reply state 000000008a722d1e transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790781.088119:0:7920:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787790781.088300:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a79f861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+44:11420:x1874634236563968:12345-192.168.201.25@tcp:36:dd.0 Request processed in 799us (993us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1787790781.088309:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 155 00000020:00080000:3.0:1787790781.088314:0:7920:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787790781.096063:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.096080:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774d1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.096088:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774d1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.096093:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790781.096098:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774d1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.096106:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774d1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.096122:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:2.0:1787790781.096125:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790781.096142:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774d1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.096149:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9774d1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.186282:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790781.480759:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790781.480857:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236564096 00000100:00100000:2.0:1787790781.480868:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236564096 00000100:00100000:2.0:1787790781.480937:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 156 00000100:00100000:2.0:1787790781.480948:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a79f87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+43:11434:x1874634236564096:12345-192.168.201.25@tcp:101:stat.0 00010000:00010000:2.0:1787790781.480973:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790781.480994:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774d24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ecac expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.481076:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa9774d2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.481091:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa9774d2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.481103:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa9774d2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.481122:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774d32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.481129:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.481135:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.481249:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774d39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.481259:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d0f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eca5 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.481267:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774d39 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.481301:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eca5 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.481314:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d0f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eca5 expref: 44 pid: 5846 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790781.481328:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5fc87840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874634253342208:192.168.201.25@tcp:104: 00000100:00100000:2.0:1787790781.481436:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67cd1540 going to sleep for 11 seconds 00000100:00100000:0.0:1787790781.493313:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790781.493497:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5fc87840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874634253342208:192.168.201.25@tcp:104: 00010000:00010000:2.0:1787790781.493529:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774d39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790781.494172:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236564352 00000100:00100000:3.0:1787790781.494180:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236564352 00000100:00100000:3.0:1787790781.494240:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:3.0:1787790781.494250:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+45:5582:x1874634236564352:12345-192.168.201.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787790781.494601:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+46:5582:x1874634236564352:12345-192.168.201.25@tcp:35:ldlm_bl.0 Request processed in 351us (1300us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1787790781.494610:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:1.0:1787790781.510920:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790781.511112:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236564480 00000100:00100000:2.0:1787790781.511122:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236564480 00010000:00010000:2.0:1787790781.511167:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d0f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eca5 expref: 46 pid: 5846 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790781.511221:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:2.0:1787790781.511249:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a79f84780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+46:2349:x1874634236564480:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790781.511634:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790781.511644:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d0f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eca5 expref: 46 pid: 5846 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.511671:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eca5 expref: 46 pid: 5846 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.511698:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d0f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eca5 expref: 46 pid: 5846 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.511715:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:2.0:1787790781.511720:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774d39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.511777:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.511785:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774d39 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.511824:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790781.511897:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790781.511906:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a79f84780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+45:2349:x1874634236564480:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 659us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790781.511924:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 67 00010000:00010000:1.0:1787790781.511924:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790781.511978:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787790781.511982:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787790781.512006:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.512022:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.512033:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa9774d2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.512040:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa9774d2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.512047:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa9774d2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.512053:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790781.512058:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa9774d2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.512065:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa9774d2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.512075:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:1.0:1787790781.512079:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790781.512083:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa9774d2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.512101:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa9774d2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.512115:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.512122:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774d32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.512127:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774d32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.512133:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654e200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790781.512136:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774d32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.512142:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774d32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.512150:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff931a4b7e7f00) 00010000:00010000:1.0:1787790781.512153:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790781.512156:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774d32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.512163:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774d32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.512210:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774d24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecac expref: 45 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.512225:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecac expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.512239:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:1.0:1787790781.512242:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787790781.512244:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654fe00, rc 0) 00000100:00100000:1.0:1787790781.512291:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a79f87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+44:11434:x1874634236564096:12345-192.168.201.25@tcp:101:stat.0 Request processed in 31345us (31570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790781.512298:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 156 00000100:00100000:1.0:1787790781.581587:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790781.581699:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236564736 00000100:00100000:2.0:1787790781.581709:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236564736 00000100:00100000:2.0:1787790781.581821:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 157 00000100:00100000:2.0:1787790781.581829:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a79f870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+44:11440:x1874634236564736:12345-192.168.201.25@tcp:36:truncate.0 00010000:00010000:2.0:1787790781.581914:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790781.581940:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774d39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecac expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.581958:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:2.0:1787790781.581962:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790781.582155:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.582169:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.582178:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787790781.582231:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1787790781.582255:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d28f7a60 reply state 0000000073146f1c transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790781.582264:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787790781.582348:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a79f870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+46:11440:x1874634236564736:12345-192.168.201.25@tcp:36:truncate.0 Request processed in 518us (770us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787790781.582355:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 157 00000020:00080000:2.0:1787790781.582360:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787790781.585509:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.585531:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.585539:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.585546:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790781.585552:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.585579:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d40 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.585599:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:3.0:1787790781.585602:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790781.585607:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d40 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.585613:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774d40 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790781.765860:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790781.766064:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236564864 00000100:00100000:0.0:1787790781.766075:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236564864 00000100:00100000:0.0:1787790781.766139:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 158 00000100:00100000:0.0:1787790781.766150:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81016940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+45:11454:x1874634236564864:12345-192.168.201.25@tcp:101:stat.0 00010000:00010000:0.0:1787790781.766175:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790781.766197:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9774d47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ecb3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766261:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774d4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766275:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774d4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766286:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774d4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766298:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774d55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766304:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766325:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766423:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980600/0x70647b5fa9774d5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766432:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980600/0x70647b5fa9774d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766439:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980600/0x70647b5fa9774d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790781.766475:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787790781.766479:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787790781.766501:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980600/0x70647b5fa9774d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766511:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980600/0x70647b5fa9774d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766518:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774d4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766524:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774d4e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766531:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774d4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766536:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790781.766540:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774d4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766553:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774d4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766566:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:0.0:1787790781.766569:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790781.766574:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774d4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766579:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774d4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766592:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766598:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774d55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766604:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766609:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790781.766612:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766618:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774d55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766624:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff931a49c31500) 00010000:00010000:0.0:1787790781.766627:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790781.766629:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774d55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766645:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774d55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766677:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9774d47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecb3 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766690:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980600/0x70647b5fa9774d5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecb3 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.766696:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:0.0:1787790781.766698:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790781.766702:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67980600, rc 0) 00000100:00100000:0.0:1787790781.766974:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81016940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+46:11454:x1874634236564864:12345-192.168.201.25@tcp:101:stat.0 Request processed in 824us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790781.766982:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 158 00000100:00100000:2.0:1787790781.878771:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790781.878894:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236565120 00000100:00100000:1.0:1787790781.878905:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236565120 00000100:00100000:1.0:1787790781.878972:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 159 00000100:00100000:1.0:1787790781.878983:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+46:11464:x1874634236565120:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1787790781.879006:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790781.879027:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774d63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ecba expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790781.879141:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787790781.879262:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774d63 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecba expref: 48 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.879277:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a488be200) 00010000:00010000:1.0:1787790781.879280:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787790781.879286:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774d63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecba expref: 48 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.879300:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41478800, rc 0) 00000100:00100000:1.0:1787790781.879382:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+47:11464:x1874634236565120:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 401us (660us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1787790781.879399:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 159 00000100:00100000:3.0:1787790781.883570:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790781.883767:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236565376 00000100:00100000:0.0:1787790781.883777:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236565376 00000100:00100000:0.0:1787790781.883873:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:0.0:1787790781.883884:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a432ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+47:11464:x1874634236565376:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:0.0:1787790781.884151:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a432ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+48:11464:x1874634236565376:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 269us (592us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787790781.884159:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:2.0:1787790781.970626:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790781.970759:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236565632 00000100:00100000:1.0:1787790781.970769:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236565632 00000100:00100000:1.0:1787790781.970894:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 160 00000100:00100000:1.0:1787790781.970905:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+48:11470:x1874634236565632:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1787790781.970930:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790781.970952:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774d71 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ecc1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.971086:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774d78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.971102:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980600/0x70647b5fa9774d5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecb3 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.971111:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774d78 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.971146:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980600/0x70647b5fa9774d5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecb3 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.971158:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980600/0x70647b5fa9774d5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecb3 expref: 49 pid: 5846 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790781.971171:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81015e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874634253342336:192.168.201.25@tcp:104: 00000100:00100000:1.0:1787790781.971270:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82300 going to sleep for 11 seconds 00000100:00100000:2.0:1787790781.980907:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81015e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874634253342336:192.168.201.25@tcp:104: 00010000:00010000:2.0:1787790781.980939:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774d78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790781.987825:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790781.988073:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236565760 00000100:00100000:3.0:1787790781.988082:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236565760 00010000:00010000:3.0:1787790781.988125:0:11653:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980600/0x70647b5fa9774d5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecb3 expref: 50 pid: 5846 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790781.988177:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:3.0:1787790781.988187:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+50:2348:x1874634236565760:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790781.988204:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790781.988212:0:11653:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980600/0x70647b5fa9774d5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecb3 expref: 50 pid: 5846 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.988226:0:11653:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980600/0x70647b5fa9774d5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecb3 expref: 50 pid: 5846 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.988249:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980600/0x70647b5fa9774d5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecb3 expref: 50 pid: 5846 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.988285:0:11653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:3.0:1787790781.988292:0:11653:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774d78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.988313:0:11653:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774d78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.988322:0:11653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774d78 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.988360:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790781.988461:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774d78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.988471:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774d78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790781.988486:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+49:2348:x1874634236565760:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 300us (669us total) trans 0 rc 0/0 00000004:00200000:2.0:1787790781.988491:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000100:00100000:3.0:1787790781.988496:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 68 00010000:00010000:2.0:1787790781.988654:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774d71 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecc1 expref: 50 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.988676:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774d78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecc1 expref: 49 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.988684:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:2.0:1787790781.988687:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787790781.988690:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41479800, rc 0) 00000100:00100000:2.0:1787790781.988764:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+49:11470:x1874634236565632:12345-192.168.201.25@tcp:101:bash.0 Request processed in 17859us (18147us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1787790781.988771:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 160 00000100:00100000:1.0:1787790781.994610:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790781.995482:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236566016 00000100:00100000:2.0:1787790781.995494:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236566016 00000100:00100000:2.0:1787790781.995556:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 161 00000100:00100000:2.0:1787790781.995563:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81015e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+49:11470:x1874634236566016:12345-192.168.201.25@tcp:36:bash.0 00010000:00010000:2.0:1787790781.995800:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774d86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.995840:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774d86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.995852:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774d86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787790781.995907:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1787790781.995929:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000544e515a reply state 0000000011a8e5b1 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774d86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790781.995937:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787790781.996026:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81015e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+52:11470:x1874634236566016:12345-192.168.201.25@tcp:36:bash.0 Request processed in 462us (1426us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787790781.996034:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 161 00000020:00080000:2.0:1787790781.996038:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787790782.001792:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774d86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.001808:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774d86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.001815:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774d86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.001823:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654ec00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790782.001827:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774d86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.001844:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774d86 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.001878:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:2.0:1787790782.001881:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790782.001886:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774d86 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.001893:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774d86 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790782.002669:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790782.002892:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236566144 00000100:00100000:0.0:1787790782.002901:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236566144 00000100:00100000:0.0:1787790782.002971:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 162 00000100:00100000:0.0:1787790782.002982:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+51:11470:x1874634236566144:12345-192.168.201.25@tcp:101:bash.0 00000100:00080000:2.0:1787790782.003195:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787790782.003270:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790782.003289:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774d8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ecc8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.003373:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774d94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.003387:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774d78 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecc1 expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.003405:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774d94 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.003439:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774d78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecc1 expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.003452:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774d78 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecc1 expref: 52 pid: 5847 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790782.003467:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4794da40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874634253342464:192.168.201.25@tcp:104: 00000100:00100000:0.0:1787790782.003554:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790782.015376:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790782.015465:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236566272 00000100:00100000:2.0:1787790782.015474:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236566272 00010000:00010000:2.0:1787790782.015517:0:8498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774d78 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecc1 expref: 53 pid: 5847 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790782.015562:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:2.0:1787790782.015572:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d790780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+53:2348:x1874634236566272:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790782.015588:0:8498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790782.015595:0:8498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774d78 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecc1 expref: 53 pid: 5847 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.015608:0:8498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774d78 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecc1 expref: 53 pid: 5847 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.015629:0:8498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:2.0:1787790782.015635:0:8498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774d94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.015644:0:8498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.015672:0:8498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774d94 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.015692:0:8498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790782.015764:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d790780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+53:2348:x1874634236566272:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 193us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790782.015772:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 69 00010000:00010000:0.0:1787790782.017111:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774d78 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecc1 expref: 52 pid: 5847 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790782.017133:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4794da40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874634253342464:192.168.201.25@tcp:104: 00010000:00010000:0.0:1787790782.017158:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.017182:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.017189:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790782.017238:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787790782.017242:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787790782.017264:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.017296:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774d8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecc8 expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.017309:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecc8 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.017316:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:0.0:1787790782.017319:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790782.017322:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981c00, rc 0) 00000100:00100000:0.0:1787790782.017370:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+51:11470:x1874634236566144:12345-192.168.201.25@tcp:101:bash.0 Request processed in 14390us (14706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790782.017377:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 162 00000100:00100000:1.0:1787790782.027269:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790782.031307:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236566528 00000100:00100000:0.0:1787790782.031320:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236566528 00000100:00100000:0.0:1787790782.031375:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:0.0:1787790782.031385:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d791a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+51:11470:x1874634236566528:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:0.0:1787790782.031761:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d791a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+52:11470:x1874634236566528:12345-192.168.201.25@tcp:35:bash.0 Request processed in 376us (4500us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1787790782.031781:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 45 00000001:00080000:1.0:1787790782.096551:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967446 is committed 00000001:00080000:1.0:1787790782.096576:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967449 is committed 00000004:00080000:1.0:1787790782.096613:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787790782.096639:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff931a492ad840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787790782.096644:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff931a4bb46400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff931a492ad300 00000020:00080000:1.0:1787790782.096647:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff931a4bb46f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff931a5f8f3000 00000100:00100000:2.0:1787790782.096876:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787790782.096899:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5fc852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253342592:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787790782.096966:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790782.097041:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253342592 00000100:00100000:2.0:1787790782.097049:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253342592 00000100:00100000:2.0:1787790782.097107:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787790782.097116:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1874634253342592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787790782.097143:0:8297:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1787790782.097177:0:8297:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f85bc, atime: 0x6a8f85bc, ctime: 0x6a8f85bc, blocks: 0x1 00010000:00010000:2.0:1787790782.097186:0:8297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9774d9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.097203:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=316s v=(0 0) 00010000:00010000:2.0:1787790782.097208:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790782.097215:0:8297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9774d9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.097233:0:8297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9774d9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.097262:0:8297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9774d9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.097271:0:8297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9774d9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.097291:0:8297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:0.0:1787790782.097815:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1787790782.097953:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787790782.098266:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3318:x1874634253342592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1148us (1297us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787790782.098279:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1787790782.098310:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790782.098318:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9774d9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.098329:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654ec00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:2.0:1787790782.098333:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9774d9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.098343:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9774d9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.098362:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9774d9b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.098369:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9774d9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.098406:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790782.098409:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790782.098411:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787790782.098420:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1787790782.098636:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff931a5fc852c0/2, rc 0, transno 4294967307 00000100:00100000:0.0:1787790782.098643:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5fc852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253342592:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787790782.101262:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790782.101474:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236566784 00000100:00100000:3.0:1787790782.101483:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236566784 00000100:00100000:3.0:1787790782.101543:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 163 00000100:00100000:3.0:1787790782.101553:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+17:11480:x1874634236566784:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1787790782.101578:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790782.101600:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774da2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eccf expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790782.103552:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787790782.103856:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774da2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eccf expref: 19 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.103871:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a488be200) 00010000:00010000:0.0:1787790782.103873:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787790782.103877:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9774da2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eccf expref: 19 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.103888:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153a00, rc 0) 00000100:00100000:0.0:1787790782.103947:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:11480:x1874634236566784:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 2397us (2694us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1787790782.103954:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 163 00000100:00100000:3.0:1787790782.106141:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790782.106282:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236566912 00000100:00100000:1.0:1787790782.106290:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236566912 00000100:00100000:1.0:1787790782.106351:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 164 00000100:00100000:1.0:1787790782.106361:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:11480:x1874634236566912:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:1.0:1787790782.106557:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774db0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.106576:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774db0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.106588:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774db0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.106604:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774db7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.106611:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774db7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.106618:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774db7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107085:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774dbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107095:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107102:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790782.107144:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107156:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774db0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107163:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774db0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107171:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774db0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107176:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790782.107180:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774db0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107256:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774db0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107269:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:1.0:1787790782.107272:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790782.107277:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774db0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107291:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774db0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107375:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774db7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107382:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774db7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107494:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774db7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107499:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41478800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790782.107503:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774db7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107510:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774db7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107519:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff931a488be600) 00010000:00010000:1.0:1787790782.107522:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790782.107524:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774db7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107530:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774db7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107546:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107553:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774dbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107566:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774dbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107571:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790782.107574:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774dbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107581:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774dbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107589:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:1.0:1787790782.107591:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790782.107595:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774dbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790782.107600:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774dbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790782.107763:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:11480:x1874634236566912:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 1401us (1626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790782.107772:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 164 00000100:00100000:1.0:1787790782.114970:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790782.115044:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236567168 00000100:00100000:0.0:1787790782.115052:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236567168 00000100:00100000:0.0:1787790782.115098:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:0.0:1787790782.115105:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:11480:x1874634236567168:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:0.0:1787790782.115884:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+19:11480:x1874634236567168:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 776us (919us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1787790782.115900:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:1.0:1787790782.165038:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790782.165122:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236567424 00000100:00100000:2.0:1787790782.165132:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236567424 00000100:00100000:2.0:1787790782.165231:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 165 00000100:00100000:2.0:1787790782.165241:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53eead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+19:11483:x1874634236567424:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1787790782.165265:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790782.165286:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774dc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ecd6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.165401:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774dcc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.165716:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774dcc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.165751:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774dcc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.165764:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774dd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.165769:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.165773:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.166122:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774dda lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.166130:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774dda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.166135:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774dda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790782.166141:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787790782.166269:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774dcc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.166274:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774dcc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.166279:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774dcc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.166282:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654e000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790782.166286:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774dcc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.166339:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774dcc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.166472:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:2.0:1787790782.166476:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790782.166482:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774dcc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.166499:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774dcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.166514:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.166520:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774dd3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.166526:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.166531:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654fc00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790782.166534:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.166541:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774dd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.166549:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff931a4b7e7e00) 00010000:00010000:2.0:1787790782.166552:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790782.166604:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774dd3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.166609:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa9774dd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.166647:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774dc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecd6 expref: 22 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.166656:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774dda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecd6 expref: 21 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.166666:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:2.0:1787790782.166668:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790782.166670:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654fe00, rc 0) 00000100:00100000:2.0:1787790782.166769:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53eead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:11483:x1874634236567424:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1530us (1741us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787790782.166775:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 165 00000100:00100000:3.0:1787790782.171834:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790782.172112:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236567680 00000100:00100000:0.0:1787790782.172122:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236567680 00000100:00100000:0.0:1787790782.172194:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 166 00000100:00100000:0.0:1787790782.172205:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:11483:x1874634236567680:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:0.0:1787790782.172271:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774de8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.172288:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.172309:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.172337:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.172344:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774de8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.172351:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774de8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.172367:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790782.172372:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774de8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.172380:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774de8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.172399:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:0.0:1787790782.172835:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787790782.172842:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774de8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.172849:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774de8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790782.173066:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:11483:x1874634236567680:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 862us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790782.173076:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 166 00000100:00100000:1.0:1787790782.177476:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790782.177625:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236567552 00000100:00100000:2.0:1787790782.177633:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236567552 00000100:00100000:2.0:1787790782.177691:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:2.0:1787790782.177698:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:2348:x1874634236567552:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790782.177711:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790782.177754:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774dda lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecd6 expref: 21 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.177769:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:2.0:1787790782.177773:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790782.177823:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+20:2348:x1874634236567552:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 125us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790782.177840:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:1.0:1787790782.178116:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790782.178152:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236567936 00000100:00100000:2.0:1787790782.178156:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236567936 00000100:00100000:2.0:1787790782.178176:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:2.0:1787790782.178180:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+20:11483:x1874634236567936:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1787790782.178344:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:11483:x1874634236567936:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 162us (228us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1787790782.178364:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 47 00010000:00010000:3.0:1787790782.207956:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790782.334938:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790782.335101:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236568192 00000100:00100000:0.0:1787790782.335113:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236568192 00000100:00100000:0.0:1787790782.335388:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 167 00000100:00100000:0.0:1787790782.335399:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:11501:x1874634236568192:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:0.0:1787790782.335421:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790782.335444:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774def lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ecdd expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.335540:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980200/0x70647b5fa9774df6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.335554:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980200/0x70647b5fa9774df6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.335565:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980200/0x70647b5fa9774df6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790782.335575:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787790782.335701:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774def lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecdd expref: 24 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.335768:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980200/0x70647b5fa9774df6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecdd expref: 23 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.335777:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:0.0:1787790782.335780:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787790782.335783:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67980200, rc 0) 00000100:00100000:0.0:1787790782.335861:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:11501:x1874634236568192:12345-192.168.201.25@tcp:101:cat.0 Request processed in 464us (935us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1787790782.335868:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 167 00000100:00100000:1.0:1787790782.367473:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790782.367869:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236568320 00000100:00100000:2.0:1787790782.367880:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236568320 00000100:00100000:2.0:1787790782.367952:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 168 00000100:00100000:2.0:1787790782.367962:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:11502:x1874634236568320:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1787790782.367986:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790782.368011:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774e04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ece4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.368079:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774e0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.368096:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774e0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.368108:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774e0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790782.368649:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787790782.368654:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787790782.368910:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774e0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.368945:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9774e04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ece4 expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.368961:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774e0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ece4 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.368982:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:2.0:1787790782.368984:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790782.368988:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654ec00, rc 0) 00000100:00100000:2.0:1787790782.369062:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+24:11502:x1874634236568320:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1101us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790782.369070:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 168 00000100:00100000:3.0:1787790782.374647:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790782.375533:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236568704 00000100:00100000:2.0:1787790782.375544:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236568704 00000100:00100000:2.0:1787790782.375609:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:2.0:1787790782.375619:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+24:11502:x1874634236568704:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1787790782.376013:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+25:11502:x1874634236568704:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 395us (1374us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787790782.376022:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:1.0:1787790782.380675:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790782.380721:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790782.380816:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790782.380853:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790782.381110:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236569088 00000100:00100000:0.0:1787790782.381121:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236569088 00000100:00100000:0.0:1787790782.381201:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236568960 00000100:00100000:0.0:1787790782.381205:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236568960 00000100:00100000:0.0:1787790782.381227:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:0.0:1787790782.381237:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2346:x1874634236569088:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790782.381325:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2346:x1874634236569088:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 89us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790782.381334:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:0.0:1787790782.381349:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:0.0:1787790782.381356:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2346:x1874634236568960:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790782.381393:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2346:x1874634236568960:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 27us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790782.381400:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:0.0:1787790782.381418:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236569216 00000100:00100000:0.0:1787790782.381428:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236569216 00000100:00100000:0.0:1787790782.381461:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 139 00000100:00100000:0.0:1787790782.381467:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2346:x1874634236569216:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790782.381493:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2346:x1874634236569216:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 27us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790782.381499:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 139 00000100:00080000:1.0:1787790782.381717:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787790782.381761:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787790782.381764:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787790782.381969:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236568832 00000100:00100000:2.0:1787790782.381974:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236568832 00000100:00100000:2.0:1787790782.382004:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 289 00000100:00100000:2.0:1787790782.382011:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45663850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:2346:x1874634236568832:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790782.382042:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45663850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:2346:x1874634236568832:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 32us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790782.382048:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 289 00000100:00100000:3.0:1787790782.382751:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790782.383137:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236569344 00000100:00100000:2.0:1787790782.383144:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236569344 00000100:00100000:2.0:1787790782.383206:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:2.0:1787790782.383215:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a48e26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+25:11502:x1874634236569344:12345-192.168.201.25@tcp:103:lfs.0 00010000:00010000:2.0:1787790782.383238:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787790782.383265:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774d94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecc8 expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.383286:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980200/0x70647b5fa9774df6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecdd expref: 24 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.383573:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774c9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec89 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790782.383583:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:2.0:1787790782.383593:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790782.383648:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a48e26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+22:11502:x1874634236569344:12345-192.168.201.25@tcp:103:lfs.0 Request processed in 433us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790782.383656:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:3.0:1787790782.386120:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790782.386228:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236569472 00000100:00100000:0.0:1787790782.386237:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236569472 00000100:00100000:0.0:1787790782.386309:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 169 00000100:00100000:0.0:1787790782.386319:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+22:11502:x1874634236569472:12345-192.168.201.25@tcp:58:lfs.0 00010000:00010000:0.0:1787790782.386451:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774e12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.386468:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774e12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.386479:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774e12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787790782.386865:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787790782.386950:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+22:11502:x1874634236569472:12345-192.168.201.25@tcp:58:lfs.0 Request processed in 631us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790782.386958:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 169 00000100:00100000:1.0:1787790782.415905:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790782.416024:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236569600 00000100:00100000:0.0:1787790782.416033:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236569600 00000100:00100000:0.0:1787790782.416318:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 170 00000100:00100000:0.0:1787790782.416330:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+22:11504:x1874634236569600:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1787790782.416362:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790782.416407:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980200/0x70647b5fa9774e19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eceb expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.416477:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774e20 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.416493:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774e20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.416660:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774e20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.416677:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9774e27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.416684:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9774e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.416691:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9774e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.417089:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774e2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.417099:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.417107:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790782.417143:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787790782.417147:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787790782.417165:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.417475:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.417486:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774e20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.417493:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774e20 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.417563:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774e20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.417571:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790782.417576:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774e20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.417583:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774e20 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.417596:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:0.0:1787790782.417599:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790782.417604:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774e20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.417611:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9774e20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.417624:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9774e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.417630:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9774e27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.417643:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9774e27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.417648:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790782.417651:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9774e27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.417657:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9774e27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.417665:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff931a49c31700) 00010000:00010000:0.0:1787790782.417668:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790782.417670:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9774e27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.417676:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9774e27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.417710:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980200/0x70647b5fa9774e19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eceb expref: 24 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.417767:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774e2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eceb expref: 23 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790782.417775:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a49c31500) 00010000:00010000:0.0:1787790782.417777:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787790782.417780:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981a00, rc 0) 00000100:00100000:0.0:1787790782.417853:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:11504:x1874634236569600:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1526us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790782.417870:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 170 00000001:00080000:2.0:1787790782.598773:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1787790782.598790:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000040:00080000:3.0:1787790782.983033:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787790782.983043:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787790782.983082:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787790782.983089:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787790782.983207:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a679c21c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874634253342720:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787790782.983305:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a44ef5900 going to sleep for 11 seconds 00000100:00100000:3.0:1787790782.988003:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a679c21c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874634253342720:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787790782.994049:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790782.995427:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236569728 00000100:00100000:2.0:1787790782.995438:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236569728 00000100:00100000:2.0:1787790782.995638:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 171 00000100:00100000:2.0:1787790782.995650:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:11515:x1874634236569728:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787790782.995684:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787790782.995838:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:11515:x1874634236569728:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 190us (1798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790782.995847:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 171 00000100:00100000:3.0:1787790783.005021:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790783.005105:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236569856 00000100:00100000:2.0:1787790783.005122:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236569856 00000100:00100000:2.0:1787790783.005179:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 172 00000100:00100000:2.0:1787790783.005190:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:11515:x1874634236569856:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787790783.005281:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774e35 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005298:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774e35 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005311:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774e35 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005328:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774e3c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005336:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774e3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005343:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774e3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005369:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774e43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005447:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005455:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790783.005495:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787790783.005499:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787790783.005518:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005530:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774e35 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005535:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774e35 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005542:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774e35 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005548:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654e000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790783.005552:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774e35 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005560:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774e35 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005572:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff931a4b7e7200) 00010000:00010000:2.0:1787790783.005575:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790783.005580:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774e35 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005586:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e000/0x70647b5fa9774e35 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005598:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774e3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005603:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774e3c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005609:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774e3c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005619:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790783.005622:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774e3c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005709:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774e3c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005718:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff931a4b7e7e00) 00010000:00010000:2.0:1787790783.005753:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790783.005756:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774e3c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005762:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774e3c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005775:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005781:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774e43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005785:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774e43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005790:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790783.005793:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774e43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005799:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774e43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005828:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a49c31500) 00010000:00010000:2.0:1787790783.005831:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790783.005833:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774e43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.005839:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774e43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790783.005920:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:11515:x1874634236569856:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 Request processed in 731us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790783.005929:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 172 00000100:00100000:0.0:1787790783.016242:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790783.016510:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236570112 00000100:00100000:3.0:1787790783.016521:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236570112 00000100:00100000:3.0:1787790783.016576:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 173 00000100:00100000:3.0:1787790783.016585:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:11515:x1874634236570112:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787790783.016605:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790783.016719:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774e4a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ecf2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.016936:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774e51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.016954:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774e51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.016966:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774e51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790783.016977:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787790783.017090:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774e51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.017098:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774e51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.017104:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774e51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.017111:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790783.017116:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774e51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.017124:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774e51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.017136:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a49c31500) 00010000:00010000:3.0:1787790783.017140:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787790783.017144:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774e51 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.017151:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774e51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.017192:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774e4a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecf2 expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.017202:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff931a4b7e7200) 00010000:00010000:3.0:1787790783.017204:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787790783.017208:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774e4a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecf2 expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.017228:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153000, rc 0) 00000100:00100000:3.0:1787790783.017302:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+24:11515:x1874634236570112:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 718us (1073us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787790783.017312:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 173 00000100:00100000:2.0:1787790783.028213:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790783.028259:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236570240 00000100:00100000:2.0:1787790783.028269:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236570240 00000100:00100000:2.0:1787790783.028448:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 174 00000100:00100000:2.0:1787790783.028460:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+24:11515:x1874634236570240:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787790783.028511:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787790783.028616:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+24:11515:x1874634236570240:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 158us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790783.028894:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 174 00000100:00100000:3.0:1787790783.031981:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790783.032397:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236570496 00000100:00100000:2.0:1787790783.032408:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236570496 00000100:00100000:2.0:1787790783.032472:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 175 00000100:00100000:2.0:1787790783.032482:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+24:11515:x1874634236570496:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787790783.032504:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790783.032508:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787790783.032543:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774e0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ece4 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.032563:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:2.0:1787790783.032568:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790783.032582:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774e5f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ecf9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787790783.036599:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1787790783.039270:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774e66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.039302:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.039314:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.039458:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa9774e5f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecf9 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.039476:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774e66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecf9 expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.039485:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff931a488be600) 00010000:00010000:1.0:1787790783.039488:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787790783.039491:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41478800, rc 0) 00000100:00100000:1.0:1787790783.039556:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+25:11515:x1874634236570496:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 7075us (7589us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1787790783.039565:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 175 00000100:00100000:2.0:1787790783.046581:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790783.046751:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236570752 00000100:00100000:3.0:1787790783.046761:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236570752 00000100:00100000:3.0:1787790783.046833:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 176 00000100:00100000:3.0:1787790783.046844:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+25:11515:x1874634236570752:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787790783.046904:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790783.046931:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774e66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ecf9 expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.046950:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff931a488be600) 00010000:00010000:3.0:1787790783.046961:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787790783.046984:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774e74 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.046997:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774e74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.047007:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774e74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.047022:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774e7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe789b59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.047042:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774e7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe789b59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.047049:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774e7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe789b59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.047319:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774e74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.047328:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774e74 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.047336:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774e74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.047343:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790783.047347:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774e74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.047356:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774e74 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.047364:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:3.0:1787790783.047367:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790783.047618:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774e74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.047698:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774e74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.047709:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774e7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe789b59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.047781:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774e7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe789b59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.047788:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774e7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe789b59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.047859:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790783.047863:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774e7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe789b59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.047869:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774e7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe789b59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.047879:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe789b59 (ffff931a541ad700) 00010000:00010000:3.0:1787790783.047881:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790783.047884:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774e7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe789b59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.047891:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774e7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe789b59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790783.050020:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+24:11515:x1874634236570752:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 3167us (3438us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787790783.050034:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 176 00000100:00100000:2.0:1787790783.061523:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790783.063053:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236570880 00000100:00100000:3.0:1787790783.063066:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236570880 00000100:00100000:1.0:1787790783.068557:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 177 00000100:00100000:1.0:1787790783.068570:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d790780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+24:11515:x1874634236570880:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790783.068604:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790783.068627:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774e82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed00 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.068664:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774e89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.068678:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.068691:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.068876:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774e82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed00 expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.068897:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774e89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed00 expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.068906:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff931a488bea00) 00010000:00010000:1.0:1787790783.068909:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787790783.068912:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41479e00, rc 0) 00000100:00100000:1.0:1787790783.068978:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d790780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+25:11515:x1874634236570880:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 411us (7468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790783.068986:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 177 00000100:00100000:3.0:1787790783.078336:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790783.078501:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236571136 00000100:00100000:2.0:1787790783.078511:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236571136 00000100:00100000:2.0:1787790783.078564:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 178 00000100:00100000:2.0:1787790783.078574:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+25:11515:x1874634236571136:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787790783.078665:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774e90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.078682:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774e90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.078695:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774e90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787790783.080125:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1787790783.080139:0:7920:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 317960414318ns, next at 318960410996ns, rc = 0 00000004:00010000:2.0:1787790783.080232:0:7920:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000675c4072 reply state 00000000f995a1c0 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774e90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790783.080256:0:7920:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787790783.080366:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+27:11515:x1874634236571136:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 1790us (2035us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1787790783.081917:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 178 00010000:00010000:3.0:1787790783.083257:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774e90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.083284:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774e90 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.083292:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774e90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.083298:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654ec00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790783.083302:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774e90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.083310:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774e90 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.083326:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff931a488bea00) 00010000:00010000:3.0:1787790783.083330:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787790783.083335:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774e90 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.083341:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774e90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790783.085283:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790783.085529:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236571264 00000100:00100000:2.0:1787790783.085539:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236571264 00000100:00100000:2.0:1787790783.085598:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 179 00000100:00100000:2.0:1787790783.085608:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+26:11515:x1874634236571264:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787790783.085633:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790783.085651:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774e97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed07 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.085710:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774e97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed07 expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.085745:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774e97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed07 expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.085765:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff931a488bea00) 00010000:00010000:2.0:1787790783.085769:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787790783.085772:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654e200, rc 0) 00000100:00100000:2.0:1787790783.085906:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+27:11515:x1874634236571264:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 298us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790783.085914:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 179 00000100:00100000:2.0:1787790783.088094:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790783.088159:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236571392 00000100:00100000:3.0:1787790783.088167:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236571392 00000100:00100000:3.0:1787790783.088217:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:3.0:1787790783.088226:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2349:x1874634236571392:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787790783.088559:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2349:x1874634236571392:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 333us (471us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787790783.088567:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 51 00000040:00080000:0.0:1787790783.090619:0:12446:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787790783.090627:0:12446:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787790783.090666:0:12446:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787790783.090671:0:12446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787790783.092199:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790783.092294:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236571648 00000100:00100000:2.0:1787790783.092310:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236571648 00000100:00100000:2.0:1787790783.092367:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:2.0:1787790783.092440:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+27:11515:x1874634236571648:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787790783.092668:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+28:11515:x1874634236571648:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 232us (476us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1787790783.092677:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:3.0:1787790783.097641:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790783.097790:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236571904 00000100:00100000:1.0:1787790783.097801:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236571904 00000100:00100000:1.0:1787790783.097876:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 180 00000100:00100000:1.0:1787790783.097888:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be39a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+28:11515:x1874634236571904:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787790783.098397:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be39a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+28:11515:x1874634236571904:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 509us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790783.098407:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 180 00000100:00100000:0.0:1787790783.101177:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790783.102080:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236572032 00000100:00100000:2.0:1787790783.102090:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236572032 00000100:00100000:2.0:1787790783.102142:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 181 00000100:00100000:2.0:1787790783.102151:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+28:11515:x1874634236572032:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787790783.102170:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790783.102189:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa9774e9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed0e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.102271:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa9774ea5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.102297:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa9774ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.102310:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa9774ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790783.102344:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787790783.102368:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa9774ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.102394:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa9774e9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed0e expref: 30 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.102421:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa9774ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed0e expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.102430:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff931a488bea00) 00010000:00010000:2.0:1787790783.102433:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787790783.102436:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654f000, rc 0) 00000100:00100000:2.0:1787790783.102498:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+29:11515:x1874634236572032:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 348us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790783.102505:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 181 00000100:00100000:0.0:1787790783.108574:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790783.109145:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236572160 00000100:00100000:1.0:1787790783.109156:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236572160 00000100:00100000:1.0:1787790783.109209:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:1.0:1787790783.109220:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7c26b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2346:x1874634236572160:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790783.109238:0:8297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790783.109261:0:8297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f35da0c/0x70647b5fa9774eac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed15 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787790783.109358:0:8297:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f85bf, blocks: 0x1 00010000:00010000:1.0:1787790783.109381:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=317s v=(0 0) 00010000:00010000:1.0:1787790783.109385:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790783.109396:0:8297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f35da0c/0x70647b5fa9774eac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed15 expref: 8 pid: 8297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.109414:0:8297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f35da0c/0x70647b5fa9774eac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed15 expref: 8 pid: 8297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.109427:0:8297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41479800, rc 0) 00000100:00100000:1.0:1787790783.109486:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7c26b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2346:x1874634236572160:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 269us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790783.109493:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:3.0:1787790783.113842:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790783.113995:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236572416 00000100:00100000:2.0:1787790783.114004:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236572416 00000100:00100000:2.0:1787790783.114054:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 182 00000100:00100000:2.0:1787790783.114063:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+29:11515:x1874634236572416:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787790783.114166:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+29:11515:x1874634236572416:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 103us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790783.114174:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 182 00000100:00100000:0.0:1787790783.117258:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790783.117498:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236572544 00000100:00100000:3.0:1787790783.117508:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236572544 00000100:00100000:3.0:1787790783.117593:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 53 00000100:00100000:3.0:1787790783.117604:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a79f84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:11515:x1874634236572544:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787790783.117630:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790783.117652:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000096ddc6a/0x70647b5fa9774eb3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed1c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.117683:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f35da0c/0x70647b5fa9774eac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed15 expref: 9 pid: 8297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.117693:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790783.117698:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790783.117705:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000096ddc6a/0x70647b5fa9774eb3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed1c expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.117769:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f35da0c/0x70647b5fa9774eac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed15 expref: 9 pid: 8297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.117786:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f35da0c/0x70647b5fa9774eac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed15 expref: 9 pid: 8297 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790783.117914:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be38b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1874634253342848:192.168.201.25@tcp:104: 00000100:00100000:0.0:1787790783.118042:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a44dc03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790783.120187:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be38b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1874634253342848:192.168.201.25@tcp:104: 00010000:00010000:0.0:1787790783.120221:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000096ddc6a/0x70647b5fa9774eb3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed1c expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790783.120240:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153600, rc 0) 00000100:00100000:0.0:1787790783.120292:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a79f84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:11515:x1874634236572544:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 2690us (3043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790783.120301:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 53 00000100:00100000:3.0:1787790783.126704:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790783.126914:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236572672 00000100:00100000:0.0:1787790783.126923:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236572672 00010000:00010000:0.0:1787790783.126957:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f35da0c/0x70647b5fa9774eac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed15 expref: 9 pid: 8297 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790783.126995:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:0.0:1787790783.127004:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:2349:x1874634236572672:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790783.127025:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790783.127046:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000007f35da0c/0x70647b5fa9774eac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed15 expref: 9 pid: 8297 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790783.127059:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f35da0c/0x70647b5fa9774eac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed15 expref: 9 pid: 8297 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790783.127082:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f35da0c/0x70647b5fa9774eac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed15 expref: 9 pid: 8297 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790783.127096:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787790783.127100:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790783.127107:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000096ddc6a/0x70647b5fa9774eb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed1c expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790783.127117:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000096ddc6a/0x70647b5fa9774eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed1c expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790783.127150:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000096ddc6a/0x70647b5fa9774eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed1c expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790783.127163:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a79f84780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5832:1874634253342976:192.168.201.25@tcp:105: 00000100:00100000:0.0:1787790783.127231:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790783.131047:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a79f84780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5832:1874634253342976:192.168.201.25@tcp:105: 00010000:00010000:0.0:1787790783.131075:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790783.131135:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2349:x1874634236572672:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 4132us (4438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790783.131147:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:3.0:1787790783.134234:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790783.134315:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236572800 00000100:00100000:1.0:1787790783.134332:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236572800 00002000:00100000:1.0:1787790783.134388:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff931a7be38780 x1874634236572800/t0(0) o4->3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp:624/0 lens 504/0 e 0 to 0 dl 1787790794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787790783.134401:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a7be38780 with x1874634236572800 ext(0->8) 00002000:00010000:1.0:1787790783.134407:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff931a7be38780 00000100:00100000:1.0:1787790783.134440:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:1.0:1787790783.134450:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be38780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2348:x1874634236572800:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787790783.134926:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be38780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+10:2348:x1874634236572800:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 Request processed in 477us (701us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787790783.134933:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00002000:00100000:1.0:1787790783.134939:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff931a7be38780 x1874634236572800/t4294967314(0) o4->3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp:624/0 lens 504/448 e 0 to 0 dl 1787790794 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787790783.134945:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a7be38780 with x1874634236572800 ext(0->8) 00002000:00010000:1.0:1787790783.134947:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff931a7be38780 00000100:00100000:1.0:1787790783.144921:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790783.147481:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236572928 00000100:00100000:2.0:1787790783.147496:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236572928 00000100:00100000:2.0:1787790783.147559:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 183 00000100:00100000:2.0:1787790783.147571:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+29:11515:x1874634236572928:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787790783.193871:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+29:11515:x1874634236572928:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 Request processed in 46290us (48946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790783.193886:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 183 00000001:00080000:1.0:1787790783.193927:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000020:00080000:1.0:1787790783.193939:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:1.0:1787790783.193956:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1787790783.193962:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:1.0:1787790783.193989:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1787790783.193998:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787790783.194101:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5fc90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253343104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787790783.194171:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790783.194229:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253343104 00000100:00100000:1.0:1787790783.194235:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253343104 00000100:00100000:1.0:1787790783.194280:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787790783.194290:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253343104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787790783.194769:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787790783.194773:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787790783 00002000:00010000:1.0:1787790783.194776:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787790783.194778:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787790783 -> 1787790783 00002000:00010000:1.0:1787790783.194780:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787790783.194827:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1874634253343104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 539us (656us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787790783.194835:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787790783.194853:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787790783.195502:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff931a5fc90b40/2, rc 0, transno 4294967315 00000100:00100000:3.0:1787790783.195511:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5fc90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253343104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787790783.199381:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790783.203498:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236573056 00000100:00100000:3.0:1787790783.203514:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236573056 00000100:00100000:3.0:1787790783.203635:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00100000:3.0:1787790783.203646:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+10:2348:x1874634236573056:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1787790783.232028:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790783.250227:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+10:2348:x1874634236573056:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 Request processed in 46573us (50850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790783.250241:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 55 00000001:00080000:3.0:1787790783.252503:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:3.0:1787790783.252522:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:2.0:1787790783.255263:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790783.255455:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236573312 00000100:00100000:1.0:1787790783.255464:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236573312 00000100:00100000:1.0:1787790783.255526:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 184 00000100:00100000:1.0:1787790783.255537:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:11515:x1874634236573312:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787790783.255586:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790783.255612:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f000/0x70647b5fa9774ea5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed0e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.255628:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff931a488bea00) 00010000:00010000:1.0:1787790783.255633:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790783.255659:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774eba lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.255687:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774eba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.255697:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774eba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790783.256042:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d3573a7 reply state 00000000c7028302 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774eba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790783.256052:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787790783.256147:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+19:11515:x1874634236573312:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 610us (892us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1787790783.256156:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 184 00010000:00010000:1.0:1787790783.260874:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774eba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.260894:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774eba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.260906:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774eba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.260912:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41478800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790783.260917:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774eba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.260925:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774eba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.260941:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff931a488bea00) 00010000:00010000:1.0:1787790783.260944:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790783.260949:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774eba lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.260956:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774eba lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790783.263016:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790783.263087:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236573440 00000100:00100000:1.0:1787790783.263103:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236573440 00000100:00100000:1.0:1787790783.263165:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:1.0:1787790783.263176:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2349:x1874634236573440:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787790783.263432:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787790783.263436:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787790783 -> 1787790782 00002000:00010000:1.0:1787790783.263438:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787790780 00002000:00010000:1.0:1787790783.263441:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787790783 -> 1787790782 00002000:00010000:1.0:1787790783.263444:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787790783.263499:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2349:x1874634236573440:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 324us (491us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787790783.263507:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:2.0:1787790783.268122:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790783.268172:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236573696 00000100:00100000:3.0:1787790783.268181:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236573696 00000100:00100000:3.0:1787790783.268234:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 185 00000100:00100000:3.0:1787790783.268245:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:11515:x1874634236573696:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787790783.268316:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ec1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.268335:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774e89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed00 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.268342:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ec1 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.268386:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774e89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed00 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.268399:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774e89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed00 expref: 18 pid: 5847 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790783.268413:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be3a580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874634253343232:192.168.201.25@tcp:104: 00000100:00100000:3.0:1787790783.268485:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff931946508480 going to sleep for 11 seconds 00000100:00100000:3.0:1787790783.271403:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790783.271474:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236573824 00000100:00100000:2.0:1787790783.271493:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236573824 00000100:00100000:1.0:1787790783.271498:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be3a580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874634253343232:192.168.201.25@tcp:104: 00010000:00010000:1.0:1787790783.271523:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ec1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.271526:0:11653:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774e89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed00 expref: 19 pid: 5847 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790783.271570:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 71 00000100:00100000:2.0:1787790783.271579:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be38b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+19:2349:x1874634236573824:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790783.271592:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790783.271599:0:11653:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774e89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed00 expref: 19 pid: 5847 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.271611:0:11653:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774e89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed00 expref: 19 pid: 5847 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.271633:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774e89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed00 expref: 19 pid: 5847 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.271648:0:11653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff931a488bea00) 00010000:00010000:2.0:1787790783.271654:0:11653:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ec1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.271663:0:11653:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.271677:0:11653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ec1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.271700:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790783.271746:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.271753:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790783.271766:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be38b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:2349:x1874634236573824:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 188us (371us total) trans 0 rc 0/0 00010000:00010000:1.0:1787790783.271780:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790783.271781:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 71 00010000:00010000:1.0:1787790783.271788:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ec1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.271794:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ec1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.271820:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790783.271828:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ec1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.271835:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ec1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.271844:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff931a488bea00) 00010000:00010000:1.0:1787790783.271846:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787790783.271850:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ec1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.271856:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ec1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790783.271895:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+17:11515:x1874634236573696:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 Request processed in 3653us (3881us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787790783.271904:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 185 00000100:00100000:2.0:1787790783.278872:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790783.279084:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236573952 00000100:00100000:1.0:1787790783.279093:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236573952 00000100:00100000:1.0:1787790783.279140:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:1.0:1787790783.279146:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2346:x1874634236573952:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787790783.279186:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000419b195a/0x70647b5fa9774ec8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.279202:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000096ddc6a/0x70647b5fa9774eb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed1c expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.279224:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790783.279227:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787790783.279231:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000419b195a/0x70647b5fa9774ec8 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.279260:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000096ddc6a/0x70647b5fa9774eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed1c expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.279270:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000096ddc6a/0x70647b5fa9774eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed1c expref: 8 pid: 6685 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790783.279284:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5fc93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1874634253343360:192.168.201.25@tcp:104: 00000100:00100000:1.0:1787790783.279365:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d815e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790783.284257:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790783.284361:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5fc93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1874634253343360:192.168.201.25@tcp:104: 00010000:00010000:1.0:1787790783.284390:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000419b195a/0x70647b5fa9774ec8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790783.284469:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236574080 00000100:00100000:2.0:1787790783.284476:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236574080 00010000:00010000:2.0:1787790783.284514:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000096ddc6a/0x70647b5fa9774eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed1c expref: 9 pid: 6685 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790783.284552:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 72 00000100:00100000:2.0:1787790783.284561:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be3a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:2348:x1874634236574080:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790783.284576:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790783.284597:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000096ddc6a/0x70647b5fa9774eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed1c expref: 9 pid: 6685 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.284610:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000096ddc6a/0x70647b5fa9774eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed1c expref: 9 pid: 6685 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.284633:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000096ddc6a/0x70647b5fa9774eb3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed1c expref: 9 pid: 6685 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.284649:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787790783.284653:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787790783.284658:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000419b195a/0x70647b5fa9774ec8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.284667:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000419b195a/0x70647b5fa9774ec8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.284712:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790783.284819:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000419b195a/0x70647b5fa9774ec8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.284829:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000419b195a/0x70647b5fa9774ec8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.284854:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000419b195a/0x70647b5fa9774ec8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.284868:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000419b195a/0x70647b5fa9774ec8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.284876:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000419b195a/0x70647b5fa9774ec8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.284883:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41478800 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790783.284886:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000419b195a/0x70647b5fa9774ec8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.284896:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000419b195a/0x70647b5fa9774ec8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790783.284902:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be3a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2348:x1874634236574080:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 341us (653us total) trans 0 rc 0/0 00010000:00010000:1.0:1787790783.284908:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000419b195a/0x70647b5fa9774ec8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790783.284909:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 72 00010000:00010000:1.0:1787790783.284915:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000419b195a/0x70647b5fa9774ec8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790783.284957:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2346:x1874634236573952:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 Request processed in 5811us (6097us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790783.284965:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:0.0:1787790783.287504:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790783.287687:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236574336 00000100:00100000:2.0:1787790783.287697:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236574336 00000100:00100000:0.0:1787790783.287926:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 186 00000100:00100000:0.0:1787790783.287939:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a79f84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+17:11515:x1874634236574336:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787790783.288015:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774ecf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790783.288121:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774ecf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790783.288134:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774ecf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790783.288473:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774ed6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790783.288485:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774e97 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed07 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790783.288493:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774ed6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790783.288535:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774e97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed07 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790783.288548:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774e97 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed07 expref: 18 pid: 5847 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790783.288561:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a79f86940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874634253343488:192.168.201.25@tcp:104: 00000100:00100000:0.0:1787790783.288644:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9c900 going to sleep for 11 seconds 00000100:00100000:3.0:1787790783.291473:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790783.291599:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a79f86940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874634253343488:192.168.201.25@tcp:104: 00010000:00010000:0.0:1787790783.291626:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774ed6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790783.294083:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236574464 00000100:00100000:1.0:1787790783.294096:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236574464 00010000:00010000:0.0:1787790783.294225:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774e97 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed07 expref: 19 pid: 5847 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790783.294268:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 73 00000100:00100000:0.0:1787790783.294565:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be183c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+19:2349:x1874634236574464:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790783.294584:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790783.294591:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774e97 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed07 expref: 19 pid: 5847 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790783.294605:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774e97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed07 expref: 19 pid: 5847 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790783.294627:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e200/0x70647b5fa9774e97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed07 expref: 19 pid: 5847 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790783.294661:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff931a488bea00) 00010000:00010000:0.0:1787790783.294667:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774ed6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790783.294676:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774ed6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790783.294684:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774ed6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790783.294709:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787790783.294776:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774ed6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.294784:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774ed6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787790783.294982:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1787790783.295147:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787790783.295479:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1787790783.295567:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be19a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874634253343616:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787790783.296019:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790783.296053:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9319465083c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790783.296096:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be183c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:2349:x1874634236574464:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 1535us (4632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790783.296105:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 73 00000100:00100000:2.0:1787790783.296174:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253343616 00000100:00100000:2.0:1787790783.296180:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253343616 00000100:00100000:2.0:1787790783.296222:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787790783.296229:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1874634253343616:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787790783.296314:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1874634253343616:12345-0@lo:1000:mdt00_002.0 Request processed in 85us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790783.296320:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787790783.296415:0:5848:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1787790783.296421:0:5848:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff931a5fc90b40, transno 4294967315 00000100:00100000:3.0:1787790783.296441:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be19a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874634253343616:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1787790783.296939:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1787790783.297003:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be19a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874634253343744:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787790783.297048:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790783.297075:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff931946508900 going to sleep for 11 seconds 00000100:00100000:2.0:1787790783.297564:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253343744 00000100:00100000:2.0:1787790783.297571:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253343744 00000100:00100000:2.0:1787790783.297614:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787790783.297622:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1874634253343744:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787790783.297852:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1874634253343744:12345-0@lo:1000:mdt00_002.0 Request processed in 229us (803us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787790783.297859:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787790783.297897:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be19a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874634253343744:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787790783.297932:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774ed6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.297941:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774ed6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.297961:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774ed6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.297968:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790783.297972:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774ed6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.297980:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774ed6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.297995:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff931a488bea00) 00010000:00010000:2.0:1787790783.297998:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787790783.298003:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774ed6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.298010:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774ed6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.298038:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774e12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.298045:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774e12 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.298050:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774e12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.298056:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790783.298058:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774e12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.298074:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774e12 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.298082:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a49c31500) 00010000:00010000:2.0:1787790783.298085:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787790783.298088:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774e12 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.298093:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774e12 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.298117:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774edd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.298129:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774e2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eceb expref: 21 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.298139:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774edd lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.298164:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774e2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eceb expref: 21 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.298177:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774e2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eceb expref: 21 pid: 7920 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790783.298188:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be152c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874634253343872:192.168.201.25@tcp:104: 00000100:00100000:2.0:1787790783.298246:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a44b6e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787790783.305959:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790783.306164:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236574592 00000100:00100000:1.0:1787790783.306179:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236574592 00010000:00010000:1.0:1787790783.306217:0:8498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774e2e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eceb expref: 22 pid: 7920 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790783.306261:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 74 00000100:00100000:1.0:1787790783.306271:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+22:2348:x1874634236574592:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790783.306293:0:8498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790783.306301:0:8498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774e2e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eceb expref: 22 pid: 7920 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.306316:0:8498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774e2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eceb expref: 22 pid: 7920 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.306338:0:8498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a49c31500) 00010000:00010000:1.0:1787790783.306344:0:8498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774edd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.306354:0:8498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774edd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.306362:0:8498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774edd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.306393:0:8498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790783.306449:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+22:2348:x1874634236574592:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 179us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790783.306457:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 74 00010000:00010000:3.0:1787790783.307128:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774e2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eceb expref: 21 pid: 7920 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790783.307146:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be152c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874634253343872:192.168.201.25@tcp:104: 00010000:00010000:3.0:1787790783.307167:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774edd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.307177:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774edd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.307184:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774edd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.307197:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774edd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.307204:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774edd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.307211:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774edd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.307217:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790783.307221:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774edd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.307229:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774edd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.307255:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a49c31500) 00010000:00010000:3.0:1787790783.307257:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790783.307261:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774edd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.307268:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9774edd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.307342:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774ecf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.307349:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774ecf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.307355:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774ecf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.307360:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790783.307363:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774ecf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.307435:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774ecf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.307445:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a49c31500) 00010000:00010000:3.0:1787790783.307447:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787790783.307450:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774ecf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790783.307457:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774ecf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790783.307893:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a79f84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+20:11515:x1874634236574336:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 19955us (20394us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787790783.307903:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 186 00000020:00080000:3.0:1787790783.307908:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787790783.308687:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787790783.308693:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787790783.309148:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787790783.309156:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787790783.311945:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790783.312013:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236574848 00000100:00100000:2.0:1787790783.312021:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236574848 00000100:00100000:2.0:1787790783.312075:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:2.0:1787790783.312086:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a432ecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+20:11515:x1874634236574848:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787790783.312628:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787790783.312699:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1787790783.312762:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774ee4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.312776:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774ee4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.312785:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774ee4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.312790:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774ee4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.312795:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774ee4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.312799:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774ee4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790783.312825:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790783.312867:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790783.312875:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774ee4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.312881:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f400 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790783.312885:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774ee4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.312892:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774ee4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790783.312903:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff931a4b7e7a00) 00010000:00010000:1.0:1787790783.312906:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:2.0:1787790783.312907:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a432ecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+22:11515:x1874634236574848:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 822us (967us total) trans 4294967468 rc 0/0 00010000:00010000:1.0:1787790783.312910:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774ee4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790783.312915:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 50 00010000:00010000:1.0:1787790783.312916:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa9774ee4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787790783.312920:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787790783.312932:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790783.312934:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790783.312935:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790783.552481:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5fc92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253344128:0@lo:400:kworker.0 00000100:00100000:1.0:1787790783.552550:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790783.552608:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790783.552614:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5fc930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253344256:0@lo:400:kworker.0 00000100:00100000:1.0:1787790783.552637:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790783.552673:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253344128 00000100:00100000:1.0:1787790783.552679:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253344128 00000100:00100000:1.0:1787790783.552757:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253344256 00000100:00100000:1.0:1787790783.552762:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253344256 00000100:00100000:1.0:1787790783.552791:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787790783.552801:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253344128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790783.552862:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253344128:12345-0@lo:400:kworker.0 Request processed in 62us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790783.552869:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787790783.552885:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787790783.552892:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253344256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790783.552915:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253344256:12345-0@lo:400:kworker.0 Request processed in 25us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790783.552920:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:1.0:1787790783.552934:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790783.552959:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5fc930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253344256:0@lo:400:kworker.0 00000100:00100000:1.0:1787790783.552967:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5fc92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253344128:0@lo:400:kworker.0 00000100:00100000:3.0:1787790783.553047:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5fc93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253344000:0@lo:400:kworker.0 00000100:00100000:3.0:1787790783.553093:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790783.553121:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5fc91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253344512:0@lo:400:kworker.0 00000100:00100000:3.0:1787790783.553142:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790783.553158:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787790783.553162:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a5fc903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1874634253344384:0@lo:400:kworker.0 00000100:00100000:3.0:1787790783.553194:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790783.553214:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253344384 00000100:00100000:3.0:1787790783.553217:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253344384 00000100:00100000:3.0:1787790783.553243:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787790783.553250:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874634253344384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790783.553282:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874634253344384:12345-0@lo:400:kworker.0 Request processed in 33us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790783.553288:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787790783.553314:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5fc903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1874634253344384:0@lo:400:kworker.0 00000100:00100000:1.0:1787790783.553990:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253344000 00000100:00100000:1.0:1787790783.553995:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253344000 00000100:00100000:1.0:1787790783.554025:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787790783.554033:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45662850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3321:x1874634253344000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790783.554093:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45662850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3321:x1874634253344000:12345-0@lo:400:kworker.0 Request processed in 61us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790783.554099:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:1.0:1787790783.554122:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790783.554143:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5fc93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253344000:0@lo:400:kworker.0 00000100:00100000:1.0:1787790783.554165:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253344512 00000100:00100000:1.0:1787790783.554168:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253344512 00000100:00100000:1.0:1787790783.554202:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787790783.554208:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253344512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790783.554243:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253344512:12345-0@lo:400:kworker.0 Request processed in 36us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790783.554249:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787790783.554270:0:3321:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1787790783.554275:0:3321:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1787790783.554289:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff931a5fc852c0, transno 4294967307 00000100:00100000:1.0:1787790783.554298:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a5fc91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253344512:0@lo:400:kworker.0 00010000:00010000:3.0:1787790784.255876:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790784.576137:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a465b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253344640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790784.576217:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790784.576483:0:8510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253344640 00000100:00100000:3.0:1787790784.576490:0:8510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253344640 00000100:00100000:3.0:1787790784.576581:0:8510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787790784.576590:0:8510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc91a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1874634253344640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790784.576613:0:8510:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787790784.576686:0:8510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc91a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1874634253344640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790784.576694:0:8510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787790784.576792:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a465b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253344640:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787790784.715424:0:12499:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787790784.715433:0:12499:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787790784.715474:0:12499:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787790784.715480:0:12499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787790784.849053:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790784.852983:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236575104 00000100:00100000:3.0:1787790784.852997:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236575104 00000100:00100000:3.0:1787790784.853088:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 187 00000100:00100000:3.0:1787790784.853098:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+22:11532:x1874634236575104:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1787790784.853123:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790784.853143:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774eeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed23 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790784.853388:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774ef2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790784.853403:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774ef2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790784.853415:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774ef2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790784.853425:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787790784.853579:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa9774eeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed23 expref: 25 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790784.853596:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774ef2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed23 expref: 24 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790784.853605:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:3.0:1787790784.853608:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787790784.853617:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153200, rc 0) 00000100:00100000:3.0:1787790784.853682:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+24:11532:x1874634236575104:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 585us (4635us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787790784.853689:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 187 00000100:00080000:2.0:1787790784.854058:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790784.862568:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790784.863504:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236575232 00000100:00100000:0.0:1787790784.863516:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236575232 00000100:00100000:0.0:1787790784.863675:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 188 00000100:00100000:0.0:1787790784.863686:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+24:11532:x1874634236575232:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:0.0:1787790784.863789:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f00 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.863806:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.863818:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.863843:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.863851:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.863857:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864149:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864158:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864165:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790784.864203:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864215:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864222:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f00 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864229:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864235:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790784.864239:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864252:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f00 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864264:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:0.0:1787790784.864267:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790784.864271:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864277:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864286:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864291:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864297:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864302:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790784.864305:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864311:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864317:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff931a49c31000) 00010000:00010000:0.0:1787790784.864319:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790784.864322:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864336:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864362:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864369:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864374:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864379:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790784.864382:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864388:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864395:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a49c31700) 00010000:00010000:0.0:1787790784.864397:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790784.864399:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.864406:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790784.864485:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+24:11532:x1874634236575232:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 800us (1926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790784.864493:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 188 00000100:00100000:3.0:1787790784.916377:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790784.916589:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236575488 00000100:00100000:0.0:1787790784.916599:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236575488 00000100:00100000:0.0:1787790784.916658:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 189 00000100:00100000:0.0:1787790784.916668:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+24:11536:x1874634236575488:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1787790784.916688:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790784.916709:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed2a expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.916832:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f1c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.916848:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.916860:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.916875:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.916882:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.916889:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.917212:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774f2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.917222:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774f2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.917239:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774f2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790784.917248:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787790784.917337:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.917345:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f1c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.917351:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.917357:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790784.917361:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.917369:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.917381:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:0.0:1787790784.917384:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790784.917389:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.917395:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.917407:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.917412:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.917423:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.917429:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790784.917432:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.917438:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.917445:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff931a49c31700) 00010000:00010000:0.0:1787790784.917448:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790784.917451:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.917457:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.917496:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed2a expref: 27 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.917510:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774f2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed2a expref: 26 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.917517:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a49c31000) 00010000:00010000:0.0:1787790784.917519:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790784.917522:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67980a00, rc 0) 00000100:00100000:0.0:1787790784.917594:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+26:11536:x1874634236575488:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 928us (1226us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1787790784.917610:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 189 00000100:00100000:2.0:1787790784.921649:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790784.921755:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236575616 00000100:00100000:0.0:1787790784.921765:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236575616 00000100:00100000:0.0:1787790784.921827:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 190 00000100:00100000:0.0:1787790784.921837:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+26:11536:x1874634236575616:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:0.0:1787790784.921897:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774f38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.921913:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.921925:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.921948:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.921955:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774f38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.921963:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774f38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.921970:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790784.921974:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774f38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.921982:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774f38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.921993:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a49c31000) 00010000:00010000:0.0:1787790784.922007:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787790784.922012:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774f38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.922018:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774f38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790784.922088:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+26:11536:x1874634236575616:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 253us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790784.922096:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 190 00000100:00100000:2.0:1787790784.928505:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790784.929073:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236575872 00000100:00100000:3.0:1787790784.929084:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236575872 00000100:00100000:3.0:1787790784.929133:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:3.0:1787790784.929142:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+26:11536:x1874634236575872:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1787790784.929364:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+27:11536:x1874634236575872:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 222us (868us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787790784.929372:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:3.0:1787790784.962002:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790784.962093:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236576128 00000100:00100000:0.0:1787790784.962104:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236576128 00000100:00100000:0.0:1787790784.962203:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 191 00000100:00100000:0.0:1787790784.962214:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+27:11063:x1874634236576128:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:0.0:1787790784.962241:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790784.962277:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774f3f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed31 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.962403:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f46 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.962419:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774f2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed2a expref: 28 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.962428:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f46 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.962463:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774f2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed2a expref: 28 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.962498:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774f2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed2a expref: 28 pid: 7920 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790784.962513:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a465b7840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1874634253344768:192.168.201.25@tcp:104: 00000100:00100000:0.0:1787790784.962615:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790784.965889:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790784.965970:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236576256 00000100:00100000:3.0:1787790784.965978:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236576256 00010000:00010000:3.0:1787790784.966022:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774f2a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed2a expref: 29 pid: 7920 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790784.966059:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 75 00000100:00100000:3.0:1787790784.966069:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be15a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+29:2348:x1874634236576256:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790784.966086:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790784.966092:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774f2a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed2a expref: 29 pid: 7920 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790784.966106:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774f2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed2a expref: 29 pid: 7920 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790784.966144:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a49c31000) 00010000:00010000:3.0:1787790784.966149:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f46 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790784.966159:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790784.966166:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f46 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790784.966186:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790784.966306:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be15a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+29:2348:x1874634236576256:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 181us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790784.966314:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 75 00010000:00010000:0.0:1787790784.966504:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9774f2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed2a expref: 28 pid: 7920 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790784.966521:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a465b7840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1874634253344768:192.168.201.25@tcp:104: 00010000:00010000:0.0:1787790784.966542:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.966551:0:7920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.966557:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790784.966574:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787790784.966771:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa9774f3f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed31 expref: 29 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.966798:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed31 expref: 28 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.966805:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a49c31000) 00010000:00010000:0.0:1787790784.966815:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787790784.966818:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981800, rc 0) 00000100:00100000:0.0:1787790784.966845:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+28:11063:x1874634236576128:12345-192.168.201.25@tcp:101:bash.0 Request processed in 4634us (4855us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787790784.966852:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 191 00000100:00100000:2.0:1787790784.970791:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790784.970882:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236576512 00000100:00100000:0.0:1787790784.970892:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236576512 00000100:00100000:0.0:1787790784.970949:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 192 00000100:00100000:0.0:1787790784.970959:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+28:11063:x1874634236576512:12345-192.168.201.25@tcp:36:bash.0 00010000:00010000:0.0:1787790784.971213:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.971232:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.971243:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787790784.971295:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1787790784.971319:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f229acb reply state 000000000ced6182 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790784.971328:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787790784.971386:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1787790784.971477:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+32:11063:x1874634236576512:12345-192.168.201.25@tcp:36:bash.0 Request processed in 519us (754us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1787790784.971485:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 192 00000020:00080000:0.0:1787790784.971489:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787790784.974477:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00010000:00010000:3.0:1787790784.974691:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790784.974703:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790784.974711:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790784.974717:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790784.974757:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790784.974775:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790784.974983:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a49c31000) 00010000:00010000:3.0:1787790784.974986:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790784.974992:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790784.974999:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa9774f54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790784.975146:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236576640 00000100:00100000:0.0:1787790784.975157:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236576640 00000100:00100000:0.0:1787790784.975237:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 193 00000100:00100000:0.0:1787790784.975246:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+31:11063:x1874634236576640:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:0.0:1787790784.975270:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790784.975285:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed38 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.975348:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed38 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.975361:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed38 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790784.975379:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a49c31000) 00010000:00010000:0.0:1787790784.975381:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787790784.975384:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981200, rc 0) 00000100:00100000:0.0:1787790784.975445:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+32:11063:x1874634236576640:12345-192.168.201.25@tcp:101:bash.0 Request processed in 201us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790784.975452:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 193 00000100:00100000:1.0:1787790784.980506:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790784.981029:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236576768 00000100:00100000:3.0:1787790784.981039:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236576768 00000100:00100000:3.0:1787790784.981111:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 58 00000100:00100000:3.0:1787790784.981122:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:11063:x1874634236576768:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1787790784.981142:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790784.981163:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e900ad/0x70647b5fa9774f62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed3f expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787790784.981191:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f85be, atime: 0x6a8f85bc, ctime: 0x6a8f85be, blocks: 0xb 00010000:00010000:3.0:1787790784.981215:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=319s v=(0 0) 00010000:00010000:3.0:1787790784.981221:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790784.981229:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e900ad/0x70647b5fa9774f62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed3f expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790784.981246:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032e900ad/0x70647b5fa9774f62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed3f expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790784.981261:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153400, rc 0) 00000100:00100000:3.0:1787790784.981331:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:11063:x1874634236576768:12345-192.168.201.25@tcp:101:bash.0 Request processed in 211us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790784.981353:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 58 00000100:00080000:2.0:1787790784.981418:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790784.984259:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790784.984367:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236576896 00000100:00100000:1.0:1787790784.984376:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236576896 00002000:00010000:1.0:1787790784.984414:0:6691:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1787790784.984419:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a465b7840 with x1874634236576896 ext(0->18446744073709551615) 00002000:00010000:1.0:1787790784.984429:0:6691:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff931a465b7840. 00000100:00100000:1.0:1787790784.984486:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:1.0:1787790784.984495:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a465b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2346:x1874634236576896:12345-192.168.201.25@tcp:10:bash.0 00002000:00010000:1.0:1787790784.984814:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787790784.984830:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787790782 -> 1787790785 00002000:00010000:1.0:1787790784.984833:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787790780 -> 1787790780 00002000:00010000:1.0:1787790784.984835:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787790782 -> 1787790785 00002000:00010000:1.0:1787790784.984838:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787790784.984896:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a465b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:2346:x1874634236576896:12345-192.168.201.25@tcp:10:bash.0 Request processed in 400us (644us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787790784.984904:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00002000:00010000:1.0:1787790784.984908:0:6691:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1787790784.984910:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a465b7840 with x1874634236576896 ext(0->18446744073709551615) 00002000:00010000:1.0:1787790784.984915:0:6691:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff931a465b7840. 00000100:00100000:0.0:1787790785.074848:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790785.074947:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236577024 00000100:00100000:1.0:1787790785.074958:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236577024 00000100:00100000:1.0:1787790785.075026:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 194 00000100:00100000:1.0:1787790785.075037:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+32:11550:x1874634236577024:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:1.0:1787790785.075119:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774f69 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075139:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774f69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075152:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774f69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075168:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774f70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075175:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075181:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075602:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774f77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075612:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774f77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075619:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774f77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790785.075661:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774f77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075671:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774f69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075678:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774f69 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075684:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774f69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075690:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790785.075695:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774f69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075702:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774f69 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075713:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:1.0:1787790785.075716:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790785.075720:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774f69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075768:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774f69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075788:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075795:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774f70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075801:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774f70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075805:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790785.075809:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774f70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075815:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774f70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075823:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff931a45fe6c00) 00010000:00010000:1.0:1787790785.075826:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790785.075829:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774f70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075834:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774f70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075848:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774f77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075854:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774f77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075865:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774f77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075870:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41478800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790785.075873:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774f77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075880:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774f77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075888:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a49c31000) 00010000:00010000:1.0:1787790785.075890:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790785.075893:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774f77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.075898:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774f77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790785.075972:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+32:11550:x1874634236577024:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 936us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790785.075981:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 194 00000100:00100000:2.0:1787790785.121635:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790785.121857:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236577280 00000100:00100000:0.0:1787790785.121867:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236577280 00000100:00100000:0.0:1787790785.121929:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 195 00000100:00100000:0.0:1787790785.121940:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+32:11553:x1874634236577280:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1787790785.121961:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790785.121982:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774f7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed46 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.122075:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774f85 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.122091:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774f85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.122104:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774f85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.122118:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9774f8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.122125:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9774f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.122131:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9774f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.122453:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9774f93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.122462:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9774f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.122469:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9774f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790785.122478:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787790785.122877:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774f85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.122886:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774f85 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.122900:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774f85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.122906:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790785.122910:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774f85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.122918:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774f85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.122931:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:0.0:1787790785.122934:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790785.122939:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774f85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.122946:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9774f85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.122958:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9774f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.122964:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9774f8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.122980:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9774f8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.122985:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790785.122989:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9774f8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.123003:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9774f8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.123011:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff931a49c31700) 00010000:00010000:0.0:1787790785.123013:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790785.123015:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9774f8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.123021:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9774f8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.123066:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9774f7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed46 expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.123080:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9774f93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed46 expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.123088:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a49c31000) 00010000:00010000:0.0:1787790785.123090:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787790785.123092:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981400, rc 0) 00000100:00100000:0.0:1787790785.123206:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+34:11553:x1874634236577280:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1267us (1579us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1787790785.123216:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 195 00000100:00100000:0.0:1787790785.134209:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790785.134310:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236577408 00000100:00100000:2.0:1787790785.134319:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236577408 00000100:00100000:2.0:1787790785.134390:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 196 00000100:00100000:2.0:1787790785.134400:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+34:11553:x1874634236577408:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:2.0:1787790785.134467:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774fa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.134485:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f46 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed31 expref: 34 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.134495:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774fa1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.134531:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed31 expref: 34 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.134545:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed31 expref: 34 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790785.134560:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be17840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874634253344896:192.168.201.25@tcp:104: 00000100:00100000:2.0:1787790785.134659:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a430c6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790785.141476:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be17840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874634253344896:192.168.201.25@tcp:104: 00010000:00010000:2.0:1787790785.141518:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774fa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790785.149122:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790785.149300:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236577664 00000100:00100000:3.0:1787790785.149310:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236577664 00000100:00100000:3.0:1787790785.149369:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:3.0:1787790785.149379:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+35:10545:x1874634236577664:12345-192.168.201.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787790785.149701:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+36:10545:x1874634236577664:12345-192.168.201.25@tcp:35:ldlm_bl.0 Request processed in 323us (589us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787790785.149710:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:3.0:1787790785.151827:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790785.151958:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236577792 00000100:00100000:0.0:1787790785.151967:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236577792 00010000:00010000:0.0:1787790785.152001:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed31 expref: 36 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790785.152060:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 76 00000100:00100000:0.0:1787790785.152069:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a48e25050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+36:2349:x1874634236577792:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790785.152095:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790785.152102:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed31 expref: 36 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.152113:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed31 expref: 36 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.152136:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa9774f46 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed31 expref: 36 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.152151:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a49c31000) 00010000:00010000:0.0:1787790785.152156:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774fa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.152165:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.152173:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774fa1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.152207:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790785.152260:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a48e25050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+35:2349:x1874634236577792:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 192us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790785.152268:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 76 00010000:00010000:2.0:1787790785.152550:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.152558:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.152587:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.152594:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774fa1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.152601:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.152607:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654ec00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790785.152612:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.152619:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774fa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.152628:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a49c31000) 00010000:00010000:2.0:1787790785.152631:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787790785.152634:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774fa1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.152640:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa9774fa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790785.152704:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+34:11553:x1874634236577408:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 18305us (18505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790785.152712:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 196 00000100:00100000:3.0:1787790785.154541:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790785.154902:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236578048 00000100:00100000:2.0:1787790785.154910:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236578048 00000100:00100000:2.0:1787790785.154963:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 53 00000100:00100000:2.0:1787790785.154972:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+34:11553:x1874634236578048:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1787790785.155195:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+35:11553:x1874634236578048:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 223us (661us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787790785.155203:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 53 00000100:00100000:0.0:1787790785.239306:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790785.239535:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236578304 00000100:00100000:3.0:1787790785.239544:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236578304 00000100:00100000:3.0:1787790785.239603:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 197 00000100:00100000:3.0:1787790785.239613:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53f04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+35:11564:x1874634236578304:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:3.0:1787790785.239640:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790785.239662:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa9774fa8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed4d expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.247565:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774faf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.247591:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774faf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.247605:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774faf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.247639:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774fb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.247647:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.247654:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.248026:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774fbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.248036:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.248043:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790785.248057:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787790785.248150:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774faf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.248157:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774faf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.248163:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774faf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.248168:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790785.248173:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774faf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.248189:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774faf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.248200:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:3.0:1787790785.248203:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790785.248208:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774faf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.248215:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774faf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.248228:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.248234:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774fb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.248239:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.248244:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790785.248246:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.248252:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774fb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.248258:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff931a541ad900) 00010000:00010000:3.0:1787790785.248261:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790785.248263:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774fb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.248279:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774fb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.248324:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa9774fa8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed4d expref: 38 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.248338:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774fbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed4d expref: 37 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.248345:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a49c31000) 00010000:00010000:3.0:1787790785.248348:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787790785.248350:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153600, rc 0) 00000100:00100000:3.0:1787790785.248421:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53f04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+37:11564:x1874634236578304:12345-192.168.201.25@tcp:101:cat.0 Request processed in 8808us (9124us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787790785.248430:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 197 00000100:00100000:3.0:1787790785.258059:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790785.258156:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236578560 00000100:00100000:2.0:1787790785.258166:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236578560 00000100:00100000:2.0:1787790785.258221:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 54 00000100:00100000:2.0:1787790785.258230:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+37:11564:x1874634236578560:12345-192.168.201.25@tcp:35:cat.0 00000100:00100000:2.0:1787790785.258481:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+38:11564:x1874634236578560:12345-192.168.201.25@tcp:35:cat.0 Request processed in 251us (431us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787790785.258489:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 54 00010000:00010000:1.0:1787790785.280108:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790785.300518:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790785.300621:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236578816 00000100:00100000:1.0:1787790785.300632:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236578816 00000100:00100000:1.0:1787790785.300695:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 198 00000100:00100000:1.0:1787790785.300704:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53f06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+38:11565:x1874634236578816:12345-192.168.201.25@tcp:36:rm.0 00010000:00010000:1.0:1787790785.300790:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787790785.300817:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa9774fbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed4d expref: 38 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.300849:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9774f93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed46 expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.300858:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa9774f5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed38 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.300865:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a49c31000) 00010000:00010000:1.0:1787790785.300874:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790785.300892:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774fcb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.300901:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774fcb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.300907:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774fcb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.300916:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774fd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.300920:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.300924:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.301189:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774fd9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.301195:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774fd9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.301204:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774fd9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787790785.301701:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1787790785.301708:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 320181983631ns, next at 321181982171ns, rc = 0 00010000:00010000:1.0:1787790785.301813:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774fe0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.301822:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.301830:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.301837:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774fe0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.301843:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774fe0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.301848:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774fe0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.301872:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790785.301897:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774fd9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.301903:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774fd9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.301909:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774fd9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.301922:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790785.301926:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774fd9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.301934:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774fd9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.301948:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a45fe6000) 00010000:00010000:1.0:1787790785.301951:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787790785.301955:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774fd9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.301961:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9774fd9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.301978:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774fcb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.301984:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774fcb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.301989:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774fcb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.301993:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790785.301996:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774fcb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.302002:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774fcb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.302017:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:1.0:1787790785.302019:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790785.302022:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774fcb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.302027:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9774fcb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790785.302035:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af2a7bf7 reply state 000000003606aab4 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790785.302043:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787790785.302113:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53f06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+37:11565:x1874634236578816:12345-192.168.201.25@tcp:36:rm.0 Request processed in 1408us (1612us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1787790785.302121:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 198 00010000:00010000:0.0:1787790785.302452:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790785.302459:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774fe0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.302466:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41478800 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:0.0:1787790785.302470:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774fe0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.302475:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774fe0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.302484:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff931a45fe6000) 00010000:00010000:0.0:1787790785.302487:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787790785.302490:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774fe0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.302495:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9774fe0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.302510:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790785.302511:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790785.302513:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790785.305364:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.305382:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774fd2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.305388:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774fd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.305394:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790785.305399:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774fd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.305406:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774fd2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.305440:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff931a45fe6c00) 00010000:00010000:1.0:1787790785.305444:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790785.305448:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774fd2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.305454:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9774fd2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790785.354578:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790785.356891:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236579072 00000100:00100000:3.0:1787790785.356905:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236579072 00000100:00100000:3.0:1787790785.356979:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 199 00000100:00100000:3.0:1787790785.356990:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+36:11571:x1874634236579072:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1787790785.357028:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790785.357050:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa9774fe7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed54 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.357192:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774fee lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.357224:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774fee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.357236:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774fee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.357261:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774ff5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.357268:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.357274:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787790785.358396:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787790785.358894:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ffc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.358909:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ffc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.358918:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ffc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.358950:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774fee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.358956:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774fee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.358962:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774fee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.358976:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790785.358980:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774fee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.358987:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774fee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.359072:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:3.0:1787790785.359076:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790785.359151:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774fee lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.359159:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9774fee lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787790785.359175:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000069a914f9 reply state 0000000047ca535e transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790785.359184:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787790785.359217:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa9774fe7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed54 expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.359231:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ffc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed54 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.359239:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a541ad000) 00010000:00010000:3.0:1787790785.359241:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787790785.359244:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153000, rc 0) 00000100:00100000:3.0:1787790785.359389:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+39:11571:x1874634236579072:12345-192.168.201.25@tcp:101:bash.0 Request processed in 2401us (4883us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1787790785.359404:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 199 00010000:00010000:3.0:1787790785.361004:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.361018:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774ff5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.361025:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774ff5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.361030:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790785.361034:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774ff5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.361041:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774ff5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.361054:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff931a541ad900) 00010000:00010000:3.0:1787790785.361057:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790785.361061:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774ff5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.361066:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa9774ff5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790785.365810:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790785.365985:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236579200 00000100:00100000:2.0:1787790785.366042:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236579200 00000100:00100000:2.0:1787790785.366129:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:2.0:1787790785.366140:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2347:x1874634236579200:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:2.0:1787790785.366160:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790785.366184:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977500a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed5b expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787790785.366230:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787790785.366261:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=320s v=(0 0) 00010000:00010000:2.0:1787790785.366266:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790785.366275:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977500a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed5b expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.366292:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977500a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed5b expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.366305:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654ec00, rc 0) 00000100:00100000:2.0:1787790785.366381:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2347:x1874634236579200:12345-192.168.201.25@tcp:101:bash.0 Request processed in 243us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790785.366389:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00080000:1.0:1787790785.367135:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787790785.374409:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790785.374649:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236579328 00000100:00100000:3.0:1787790785.374659:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236579328 00000100:00100000:3.0:1787790785.374710:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:3.0:1787790785.374718:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:11571:x1874634236579328:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1787790785.374765:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790785.374813:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de6fa3d4/0x70647b5fa9775011 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed62 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.374852:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977500a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed5b expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.374861:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790785.374865:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790785.374870:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de6fa3d4/0x70647b5fa9775011 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed62 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.374907:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977500a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed5b expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.374919:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977500a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed5b expref: 7 pid: 6684 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790785.374932:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6683:1874634253345024:192.168.201.25@tcp:104: 00000100:00100000:2.0:1787790785.375320:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff931946508d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790785.379007:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790785.379431:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236579456 00000100:00100000:3.0:1787790785.379442:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236579456 00010000:00010000:3.0:1787790785.379488:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977500a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed5b expref: 8 pid: 6684 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790785.379544:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 77 00000100:00100000:3.0:1787790785.379554:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be29680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2348:x1874634236579456:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790785.379570:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790785.379621:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977500a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed5b expref: 8 pid: 6684 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.379636:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977500a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed5b expref: 8 pid: 6684 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.379659:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790785.379664:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790785.379672:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000de6fa3d4/0x70647b5fa9775011 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed62 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.379682:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de6fa3d4/0x70647b5fa9775011 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed62 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.379718:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000de6fa3d4/0x70647b5fa9775011 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed62 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790785.379784:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1874634253345152:192.168.201.25@tcp:105: 00000100:00100000:3.0:1787790785.379850:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff931946508900 going to sleep for 11 seconds 00010000:00010000:2.0:1787790785.380178:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa977500a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed5b expref: 8 pid: 6684 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790785.380194:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6683:1874634253345024:192.168.201.25@tcp:104: 00010000:00010000:2.0:1787790785.380215:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000de6fa3d4/0x70647b5fa9775011 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed62 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.380225:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82152800, rc 0) 00000100:00100000:2.0:1787790785.380276:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:11571:x1874634236579328:12345-192.168.201.25@tcp:101:bash.0 Request processed in 5558us (5878us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790785.380293:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:3.0:1787790785.384415:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1874634253345152:192.168.201.25@tcp:105: 00010000:00010000:3.0:1787790785.384441:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790785.385225:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be29680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2348:x1874634236579456:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 5667us (6230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790785.385245:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 77 00000100:00100000:0.0:1787790785.385870:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790785.385908:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236579712 00000100:00100000:2.0:1787790785.385915:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236579712 00000100:00100000:2.0:1787790785.385959:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00100000:2.0:1787790785.385968:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+38:11571:x1874634236579712:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:2.0:1787790785.387892:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+39:11571:x1874634236579712:12345-192.168.201.25@tcp:35:bash.0 Request processed in 1913us (2013us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787790785.387906:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00100000:1.0:1787790785.520985:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790785.521110:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236579840 00000100:00100000:0.0:1787790785.521119:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236579840 00000100:00100000:0.0:1787790785.521172:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 200 00000100:00100000:0.0:1787790785.521179:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+39:11588:x1874634236579840:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1787790785.521218:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790785.521236:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9775018 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed69 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.521298:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980200/0x70647b5fa977501f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.521309:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980200/0x70647b5fa977501f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.521318:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980200/0x70647b5fa977501f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790785.521390:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787790785.521394:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787790785.521410:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980200/0x70647b5fa977501f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.521430:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9775018 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed69 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.521443:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980200/0x70647b5fa977501f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed69 expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.521449:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:0.0:1787790785.521451:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787790785.521453:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67980200, rc 0) 00000100:00100000:0.0:1787790785.521508:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+40:11588:x1874634236579840:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 330us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790785.521513:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 200 00000100:00100000:3.0:1787790785.524830:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790785.524924:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236580096 00000100:00100000:0.0:1787790785.524932:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236580096 00000100:00100000:0.0:1787790785.524979:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 201 00000100:00100000:0.0:1787790785.524989:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+40:11588:x1874634236580096:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1787790785.525009:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790785.525031:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775026 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed70 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.525124:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981600/0x70647b5fa977502d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.525136:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981600/0x70647b5fa977502d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.525144:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981600/0x70647b5fa977502d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790785.525151:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787790785.525315:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775026 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed70 expref: 43 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.525334:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981600/0x70647b5fa977502d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed70 expref: 42 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.525342:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a541ad000) 00010000:00010000:0.0:1787790785.525344:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790785.525348:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981600, rc 0) 00000100:00100000:0.0:1787790785.525410:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+42:11588:x1874634236580096:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 421us (589us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1787790785.525432:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 201 00000100:00100000:3.0:1787790785.527714:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790785.527928:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790785.528004:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236580224 00000100:00100000:2.0:1787790785.528011:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236580224 00000100:00100000:2.0:1787790785.528060:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:2.0:1787790785.528066:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be18f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+42:2346:x1874634236580224:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790785.528077:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790785.528100:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981600/0x70647b5fa977502d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed70 expref: 42 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.528115:0:11653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a541ad000) 00010000:00010000:2.0:1787790785.528119:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790785.528153:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be18f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+41:2346:x1874634236580224:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 89us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790785.528158:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:1.0:1787790785.528337:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236580480 00000100:00100000:1.0:1787790785.528342:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236580480 00000100:00100000:1.0:1787790785.528375:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 202 00000100:00100000:1.0:1787790785.528380:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+41:11588:x1874634236580480:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1787790785.528397:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790785.528410:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa977503b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed77 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.528480:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9775042 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.528489:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9775042 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.528496:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9775042 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790785.528506:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787790785.528629:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa977503b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed77 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.528644:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9775042 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed77 expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.528651:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a541ad000) 00010000:00010000:1.0:1787790785.528654:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787790785.528656:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41479200, rc 0) 00000100:00100000:1.0:1787790785.528696:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+43:11588:x1874634236580480:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 314us (766us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1787790785.528702:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 202 00000100:00100000:3.0:1787790785.533564:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790785.533621:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236580608 00000100:00100000:2.0:1787790785.533631:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236580608 00000100:00100000:2.0:1787790785.533781:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:2.0:1787790785.533793:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+6:2349:x1874634236580608:12345-192.168.201.25@tcp:1:lfs.0 00010000:00010000:2.0:1787790785.533854:0:8297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9775050 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.533875:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000de6fa3d4/0x70647b5fa9775011 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed62 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.533883:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790785.533887:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787790785.533892:0:8297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9775050 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.533929:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000de6fa3d4/0x70647b5fa9775011 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed62 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.533943:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000de6fa3d4/0x70647b5fa9775011 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed62 expref: 6 pid: 6683 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790785.533958:0:8297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be17840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8297:1874634253345280:192.168.201.25@tcp:104: 00000100:00100000:2.0:1787790785.534382:0:8297:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a46241240 going to sleep for 11 seconds 00000100:00100000:3.0:1787790785.537802:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790785.537945:0:8297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be17840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8297:1874634253345280:192.168.201.25@tcp:104: 00010000:00010000:2.0:1787790785.537971:0:8297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9775050 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790785.538065:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236580736 00000100:00100000:0.0:1787790785.538073:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236580736 00002000:00100000:0.0:1787790785.538120:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff931a7be1a940 x1874634236580736/t0(0) o4->3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp:626/0 lens 504/0 e 0 to 0 dl 1787790796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787790785.538129:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a7be1a940 with x1874634236580736 ext(0->8) 00010000:00010000:0.0:1787790785.538136:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000de6fa3d4/0x70647b5fa9775011 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed62 expref: 7 pid: 6683 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.538149:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000de6fa3d4/0x70647b5fa9775011 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed62 expref: 7 pid: 6683 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787790785.538157:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff931a7be1a940 00000100:00100000:0.0:1787790785.538236:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:0.0:1787790785.538246:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2349:x1874634236580736:12345-192.168.201.25@tcp:4:lfs.0 00000100:00100000:0.0:1787790785.538813:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:2349:x1874634236580736:12345-192.168.201.25@tcp:4:lfs.0 Request processed in 568us (1020us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787790785.538820:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 3 00002000:00100000:0.0:1787790785.538824:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff931a7be1a940 x1874634236580736/t4294967308(0) o4->3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp:626/0 lens 504/448 e 0 to 0 dl 1787790796 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787790785.538830:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a7be1a940 with x1874634236580736 ext(0->8) 00010000:00010000:0.0:1787790785.538834:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000de6fa3d4/0x70647b5fa9775011 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed62 expref: 9 pid: 6683 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.538852:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000de6fa3d4/0x70647b5fa9775011 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed62 expref: 9 pid: 6683 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787790785.538856:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff931a7be1a940 00000100:00100000:3.0:1787790785.541054:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790785.541150:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236580864 00000100:00100000:1.0:1787790785.541158:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236580864 00010000:00010000:1.0:1787790785.541191:0:8498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000de6fa3d4/0x70647b5fa9775011 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed62 expref: 9 pid: 6683 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790785.541233:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00100000:1.0:1787790785.541242:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:2346:x1874634236580864:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790785.541258:0:8498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787790785.541277:0:8498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787790785.541279:0:8498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787790785 00002000:00010000:1.0:1787790785.541282:0:8498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787790785 00002000:00010000:1.0:1787790785.541283:0:8498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787790785 00010000:00010000:1.0:1787790785.541288:0:8498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000de6fa3d4/0x70647b5fa9775011 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed62 expref: 9 pid: 6683 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.541309:0:8498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000de6fa3d4/0x70647b5fa9775011 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed62 expref: 9 pid: 6683 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.541331:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de6fa3d4/0x70647b5fa9775011 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed62 expref: 9 pid: 6683 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.541348:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787790785.541353:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787790785.541359:0:8498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9775050 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.541369:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9775050 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.541402:0:8498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790785.541447:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2346:x1874634236580864:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 206us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790785.541452:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 78 00010000:00010000:2.0:1787790785.541506:0:8297:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9775050 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.541530:0:8297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9775050 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.541557:0:8297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9775050 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.541566:0:8297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9775050 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.541576:0:8297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9775050 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.541585:0:8297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654ec00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:2.0:1787790785.541589:0:8297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9775050 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.541599:0:8297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9775050 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.541967:0:8297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9775050 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.541975:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f311b88b/0x70647b5fa9775050 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790785.542063:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2349:x1874634236580608:12345-192.168.201.25@tcp:1:lfs.0 Request processed in 8273us (8508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790785.542074:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:3.0:1787790785.544475:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790785.544817:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236581120 00000100:00100000:1.0:1787790785.544826:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236581120 00000100:00100000:1.0:1787790785.544882:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:2.0:1787790785.544888:0:5850:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1787790785.544894:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a432ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+43:11588:x1874634236581120:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1787790785.544903:0:5850:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000004:00010000:1.0:1787790785.544960:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9775042 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed77 expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787790785.545237:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1787790785.545274:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1787790785.545565:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1787790785.545615:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775057 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.545630:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ffc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed54 expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.545639:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775057 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.545683:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ffc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed54 expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.545698:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ffc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed54 expref: 47 pid: 5847 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790785.545712:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8123b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874634253345408:192.168.201.25@tcp:104: 00000100:00100000:1.0:1787790785.545845:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787790785.548990:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8123b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874634253345408:192.168.201.25@tcp:104: 00010000:00010000:1.0:1787790785.549022:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775057 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790785.549478:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790785.549524:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236581248 00000100:00100000:2.0:1787790785.549531:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236581248 00010000:00010000:2.0:1787790785.549565:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ffc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed54 expref: 48 pid: 5847 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790785.549600:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:2.0:1787790785.549678:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+48:2349:x1874634236581248:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790785.549695:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790785.549702:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ffc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed54 expref: 48 pid: 5847 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.549715:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ffc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed54 expref: 48 pid: 5847 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.549756:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153000/0x70647b5fa9774ffc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed54 expref: 48 pid: 5847 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.549784:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a541ad000) 00010000:00010000:2.0:1787790785.549790:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775057 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.549818:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775057 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.549827:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775057 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.549915:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790785.549938:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775057 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.549948:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775057 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790785.549969:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+47:2349:x1874634236581248:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 360us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790785.549979:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 79 00000001:00080000:1.0:1787790785.550526:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1787790785.550850:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1787790785.550952:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8123b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874634253345536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787790785.550991:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790785.551062:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787790785.551437:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253345536 00000100:00100000:2.0:1787790785.551443:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253345536 00000100:00100000:2.0:1787790785.551524:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787790785.551533:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8123a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874634253345536:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787790785.551615:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8123a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874634253345536:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 83us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790785.551623:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787790785.551786:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8123b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874634253345536:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1787790785.551824:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787790785.553022:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1787790785.553087:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be183c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874634253345664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787790785.553130:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790785.553151:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff931946508780 going to sleep for 11 seconds 00000100:00100000:2.0:1787790785.553171:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253345664 00000100:00100000:2.0:1787790785.553177:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253345664 00000100:00100000:2.0:1787790785.553215:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787790785.553235:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874634253345664:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787790785.553394:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1874634253345664:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 171us (261us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787790785.553402:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787790785.553540:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be183c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874634253345664:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787790785.553587:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1787790785.553621:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775057 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.553632:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775057 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.553639:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775057 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.553645:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790785.553649:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775057 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.553657:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775057 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.553693:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a541ad000) 00010000:00010000:3.0:1787790785.553696:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787790785.553703:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775057 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.553709:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775057 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787790785.553897:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787790785.553960:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1787790785.553968:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 320434243911ns, next at 321434242381ns, rc = 0 00000001:00080000:3.0:1787790785.553972:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1787790785.553993:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a541ad000) 00010000:00010000:3.0:1787790785.553996:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787790785.554002:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9775042 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed77 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790785.554084:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a432ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+50:11588:x1874634236581120:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 9194us (9618us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1787790785.554090:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 56 00000020:00080000:3.0:1787790785.554092:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787790785.556855:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790785.556936:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236581376 00000100:00100000:0.0:1787790785.556945:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236581376 00000100:00100000:0.0:1787790785.557008:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 203 00000100:00100000:0.0:1787790785.557017:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+50:11588:x1874634236581376:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1787790785.557037:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790785.557097:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa977505e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed7e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.557163:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa977505e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed7e expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.557179:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa977505e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed7e expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.557195:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:0.0:1787790785.557198:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787790785.557202:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981000, rc 0) 00000100:00100000:0.0:1787790785.557509:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+51:11588:x1874634236581376:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 491us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790785.557517:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 203 00000100:00100000:0.0:1787790785.560658:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790785.560805:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236581632 00000100:00100000:2.0:1787790785.560815:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236581632 00000100:00100000:2.0:1787790785.560928:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:2.0:1787790785.560941:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+51:11588:x1874634236581632:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1787790785.561153:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+52:11588:x1874634236581632:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 213us (504us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787790785.561159:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:3.0:1787790785.599892:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790785.599916:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253345792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790785.599991:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790785.600095:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253345792 00000100:00100000:0.0:1787790785.600103:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253345792 00000100:00100000:0.0:1787790785.600151:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787790785.600166:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf12d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1874634253345792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787790785.600190:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787790785.600317:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf12d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1874634253345792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790785.600324:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787790785.600437:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253345792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790785.642608:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790785.642758:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236581760 00000100:00100000:1.0:1787790785.642778:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236581760 00000100:00100000:1.0:1787790785.642842:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 204 00000100:00100000:1.0:1787790785.642853:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+52:11598:x1874634236581760:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:1.0:1787790785.642930:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9775065 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.642950:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9775065 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.642962:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9775065 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.642980:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977506c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.642987:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977506c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.642994:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977506c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643096:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9775073 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643117:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9775073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643124:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9775073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790785.643166:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9775073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643179:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9775065 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643185:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9775065 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643192:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9775065 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643198:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41478800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790785.643202:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9775065 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643209:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9775065 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643221:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:1.0:1787790785.643224:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790785.643229:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9775065 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643235:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9775065 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643257:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977506c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643262:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977506c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643268:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977506c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643273:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790785.643276:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977506c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643282:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977506c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643289:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff931a45fe6c00) 00010000:00010000:1.0:1787790785.643292:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790785.643294:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977506c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643301:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977506c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643315:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9775073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643320:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9775073 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643326:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9775073 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643336:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790785.643339:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9775073 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643345:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9775073 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643354:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:1.0:1787790785.643356:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790785.643359:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9775073 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.643364:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479200/0x70647b5fa9775073 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790785.643441:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+52:11598:x1874634236581760:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 590us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790785.643449:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 204 00000100:00100000:3.0:1787790785.690016:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790785.690287:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236582016 00000100:00100000:0.0:1787790785.690297:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236582016 00000100:00100000:0.0:1787790785.690357:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 205 00000100:00100000:0.0:1787790785.690365:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+52:11601:x1874634236582016:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1787790785.690384:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790785.690403:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa977507a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed85 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690499:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9775081 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690511:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9775081 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690519:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9775081 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690528:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9775088 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690540:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9775088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690544:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9775088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690650:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977508f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690658:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977508f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690665:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977508f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790785.690673:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787790785.690804:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9775081 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690811:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9775081 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690818:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9775081 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690823:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790785.690828:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9775081 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690834:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9775081 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690858:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:0.0:1787790785.690861:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790785.690865:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9775081 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690870:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9775081 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690883:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9775088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690888:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9775088 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690893:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9775088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690898:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790785.690900:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9775088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690905:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9775088 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690911:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff931a49c31e00) 00010000:00010000:0.0:1787790785.690913:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790785.690916:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9775088 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690921:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa9775088 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690964:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981200/0x70647b5fa977507a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed85 expref: 55 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690976:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977508f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed85 expref: 54 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.690983:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:0.0:1787790785.690985:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790785.690987:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981800, rc 0) 00000100:00100000:0.0:1787790785.691037:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+54:11601:x1874634236582016:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 672us (1033us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1787790785.691044:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 205 00000100:00100000:0.0:1787790785.694661:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790785.696222:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236582144 00000100:00100000:1.0:1787790785.696235:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236582144 00000100:00100000:0.0:1787790785.696418:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 206 00000100:00100000:0.0:1787790785.696429:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+54:11601:x1874634236582144:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:0.0:1787790785.696495:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa977509d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.696511:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa977509d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.696522:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa977509d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.696548:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa977509d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.696555:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa977509d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.696576:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa977509d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.696583:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790785.696587:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa977509d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.696595:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa977509d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.696617:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:0.0:1787790785.696621:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787790785.696626:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa977509d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.696631:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa977509d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790785.696712:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+54:11601:x1874634236582144:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 284us (2061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790785.696720:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 206 00000100:00100000:1.0:1787790785.703210:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790785.703836:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236582400 00000100:00100000:3.0:1787790785.703859:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236582400 00000100:00100000:3.0:1787790785.703913:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 58 00000100:00100000:3.0:1787790785.703924:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8123b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+54:11601:x1874634236582400:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1787790785.704170:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8123b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+55:11601:x1874634236582400:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 247us (970us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787790785.704178:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 58 00000100:00100000:3.0:1787790785.781159:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790785.781227:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236582656 00000100:00100000:0.0:1787790785.781238:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236582656 00000100:00100000:0.0:1787790785.781405:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 207 00000100:00100000:0.0:1787790785.781416:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf10780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+55:11611:x1874634236582656:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:0.0:1787790785.781439:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790785.781443:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787790785.781470:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980200/0x70647b5fa977501f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed69 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.781508:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:0.0:1787790785.781513:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787790785.781527:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa97750a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed8c expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.781620:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa97750ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.781707:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977508f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed85 expref: 55 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.781717:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa97750ab lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.781927:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977508f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed85 expref: 55 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.781941:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977508f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed85 expref: 55 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790785.781954:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be29e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1874634253345920:192.168.201.25@tcp:104: 00000100:00100000:0.0:1787790785.782049:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787790785.785897:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790785.786007:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be29e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1874634253345920:192.168.201.25@tcp:104: 00010000:00010000:3.0:1787790785.786034:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa97750ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790785.786090:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236582784 00000100:00100000:1.0:1787790785.786097:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236582784 00010000:00010000:1.0:1787790785.786132:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977508f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed85 expref: 56 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790785.786167:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 80 00000100:00100000:1.0:1787790785.786178:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be28780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+56:2349:x1874634236582784:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790785.786192:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790785.786210:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977508f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed85 expref: 56 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.786223:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977508f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed85 expref: 56 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.786244:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977508f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed85 expref: 56 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.786258:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:1.0:1787790785.786263:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa97750ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.786272:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa97750ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.786295:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa97750ab lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.786319:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790785.786377:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be28780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+55:2349:x1874634236582784:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 201us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790785.786386:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 80 00010000:00010000:3.0:1787790785.786486:0:7920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa97750ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.786495:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa97750ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790785.786516:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787790785.786661:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa97750a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed8c expref: 56 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.787159:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa97750ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed8c expref: 55 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.787169:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:3.0:1787790785.787172:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787790785.787174:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67980c00, rc 0) 00000100:00100000:3.0:1787790785.787214:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf10780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+55:11611:x1874634236582656:12345-192.168.201.25@tcp:101:bash.0 Request processed in 5800us (6065us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1787790785.787231:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 207 00000100:00100000:0.0:1787790785.790805:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790785.791840:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236583040 00000100:00100000:2.0:1787790785.791853:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236583040 00000100:00100000:2.0:1787790785.791917:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 208 00000100:00100000:2.0:1787790785.791928:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+55:11611:x1874634236583040:12345-192.168.201.25@tcp:36:bash.0 00010000:00010000:2.0:1787790785.792187:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97750b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.792204:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97750b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.792215:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97750b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787790785.792264:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1787790785.792311:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c35a450c reply state 000000001f894663 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97750b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790785.792319:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787790785.792410:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+58:11611:x1874634236583040:12345-192.168.201.25@tcp:36:bash.0 Request processed in 483us (1614us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787790785.792418:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 208 00000020:00080000:2.0:1787790785.792422:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787790785.798273:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97750b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.798437:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97750b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.798458:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97750b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.798465:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654ec00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790785.798469:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97750b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.798478:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97750b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.798495:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:2.0:1787790785.798499:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790785.798503:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97750b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.798510:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97750b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790785.806562:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790785.807975:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236583168 00000100:00100000:3.0:1787790785.807987:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236583168 00000100:00100000:3.0:1787790785.808093:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 209 00000100:00100000:3.0:1787790785.808105:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+57:11611:x1874634236583168:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1787790785.808129:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790785.808148:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa97750c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed93 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.808237:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97750c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.808252:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa97750ab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed8c expref: 58 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.808261:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97750c7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.808304:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa97750ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed8c expref: 58 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.808317:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa97750ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed8c expref: 58 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790785.808341:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf10000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874634253346048:192.168.201.25@tcp:104: 00000100:00100000:3.0:1787790785.808433:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff931946508600 going to sleep for 11 seconds 00000100:00100000:1.0:1787790785.812672:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790785.812794:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf10000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874634253346048:192.168.201.25@tcp:104: 00010000:00010000:3.0:1787790785.812842:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97750c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790785.813081:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236583296 00000100:00100000:0.0:1787790785.813089:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236583296 00010000:00010000:0.0:1787790785.813131:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa97750ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed8c expref: 59 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790785.813172:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 81 00000100:00100000:0.0:1787790785.813182:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a812383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+59:2349:x1874634236583296:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790785.813197:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790785.813204:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa97750ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed8c expref: 59 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.813217:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa97750ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed8c expref: 59 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.813238:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa97750ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed8c expref: 59 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.813253:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:0.0:1787790785.813258:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97750c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.813267:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97750c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.813284:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97750c7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.813317:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790785.813449:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97750c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.813456:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97750c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790785.813499:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787790785.813510:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787790785.813533:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97750c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.813563:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152000/0x70647b5fa97750c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed93 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.813578:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97750c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed93 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.813586:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:1.0:1787790785.813588:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787790785.813591:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82152200, rc 0) 00000100:00100000:1.0:1787790785.813656:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+58:11611:x1874634236583168:12345-192.168.201.25@tcp:101:bash.0 Request processed in 5553us (7105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790785.813664:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 209 00000100:00100000:1.0:1787790785.813983:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a812383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+57:2349:x1874634236583296:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 801us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790785.813990:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 81 00000100:00100000:1.0:1787790785.818060:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790785.818261:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236583552 00000100:00100000:3.0:1787790785.818271:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236583552 00000100:00100000:3.0:1787790785.818412:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:3.0:1787790785.818422:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81239a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+57:11611:x1874634236583552:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:3.0:1787790785.818656:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81239a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+58:11611:x1874634236583552:12345-192.168.201.25@tcp:35:bash.0 Request processed in 235us (605us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1787790785.818664:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:2.0:1787790785.877591:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790785.877703:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236583680 00000100:00100000:0.0:1787790785.877713:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236583680 00000100:00100000:0.0:1787790785.877858:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 210 00000100:00100000:0.0:1787790785.877869:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+58:11617:x1874634236583680:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1787790785.877910:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790785.877931:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa97750ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ed9a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.877997:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa97750d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.878011:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa97750d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.878022:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa97750d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790785.878083:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787790785.878087:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787790785.878109:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa97750d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.878133:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980c00/0x70647b5fa97750ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed9a expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.878151:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa97750d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed9a expref: 59 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.878159:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:0.0:1787790785.878162:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787790785.878166:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67980000, rc 0) 00000100:00100000:0.0:1787790785.878236:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+59:11617:x1874634236583680:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 362us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790785.878244:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 210 00000100:00100000:0.0:1787790785.886905:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790785.887049:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236583808 00000100:00100000:3.0:1787790785.887059:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236583808 00000100:00100000:3.0:1787790785.887119:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 211 00000100:00100000:3.0:1787790785.887129:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+59:11617:x1874634236583808:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1787790785.887150:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790785.887170:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97750dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eda1 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887245:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa97750e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887259:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa97750e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887269:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa97750e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887283:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97750ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887302:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97750ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887309:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97750ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887413:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa97750f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887421:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa97750f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887428:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa97750f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790785.887462:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787790785.887466:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787790785.887484:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa97750f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887497:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa97750f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887505:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa97750e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887512:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa97750e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887518:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa97750e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887534:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790785.887537:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa97750e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887544:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa97750e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887556:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:3.0:1787790785.887559:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790785.887563:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa97750e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887569:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa97750e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887582:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97750ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887588:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97750ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887593:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97750ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887598:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790785.887600:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97750ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887605:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97750ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887620:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff931a541ad000) 00010000:00010000:3.0:1787790785.887622:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790785.887625:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97750ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887630:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97750ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887657:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97750dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eda1 expref: 61 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887670:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa97750f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eda1 expref: 60 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.887677:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:3.0:1787790785.887679:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787790785.887681:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153800, rc 0) 00000100:00100000:3.0:1787790785.887865:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+60:11617:x1874634236583808:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 737us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790785.887873:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 211 00000100:00100000:3.0:1787790785.894363:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790785.894581:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236584064 00000100:00100000:0.0:1787790785.894591:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236584064 00000100:00100000:0.0:1787790785.894654:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 212 00000100:00100000:0.0:1787790785.894664:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+60:11617:x1874634236584064:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1787790785.894685:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790785.894709:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa97750f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eda8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.895047:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa97750ff lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.895061:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97750c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed93 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.895070:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa97750f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eda1 expref: 61 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.895078:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa97750ff lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.895114:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa97750f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eda1 expref: 61 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.895128:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa97750f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eda1 expref: 61 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790785.895142:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931946936580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874634253346176:192.168.201.25@tcp:104: 00010000:00010000:0.0:1787790785.895247:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97750c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed93 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.895274:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97750c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed93 expref: 61 pid: 5847 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790785.895283:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d80b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874634253346304:192.168.201.25@tcp:104: 00000100:00100000:0.0:1787790785.895307:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9c540 going to sleep for 11 seconds 00000100:00100000:0.0:1787790785.898491:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00010000:00010000:0.0:1787790785.899574:0:5848:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.25@tcp) returned -22 from blocking AST (req@000000008ef16535 x1874634253346176) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa97750f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eda1 expref: 61 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.899596:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa97750f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eda1 expref: 61 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.899619:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153800/0x70647b5fa97750f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eda1 expref: 61 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790785.899634:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931946936580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874634253346176:192.168.201.25@tcp:104: 00000100:00100000:0.0:1787790785.899648:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d80b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874634253346304:192.168.201.25@tcp:104: 00010000:00010000:0.0:1787790785.899669:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:0.0:1787790785.899675:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa97750ff lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.899683:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa97750ff lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.899692:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa97750ff lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790785.899871:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236584192 00000100:00100000:2.0:1787790785.899880:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236584192 00000100:00100000:2.0:1787790785.899937:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:2.0:1787790785.899947:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a48e26450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+61:2346:x1874634236584192:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790785.899960:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790785.899963:0:5833:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 70647b5fa97750f1) 00010000:00010000:2.0:1787790785.899965:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790785.900022:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a48e26450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+61:2346:x1874634236584192:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 77us (1540us total) trans 0 rc 116/116 00000100:00100000:2.0:1787790785.900029:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:3.0:1787790785.902964:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790785.903621:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236584320 00000100:00100000:2.0:1787790785.903632:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236584320 00010000:00010000:2.0:1787790785.903676:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97750c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed93 expref: 61 pid: 5847 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790785.903710:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 82 00000100:00100000:2.0:1787790785.903720:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf13c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+61:2349:x1874634236584320:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790785.903778:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790785.903786:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97750c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed93 expref: 61 pid: 5847 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.903799:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97750c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed93 expref: 61 pid: 5847 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.903826:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa97750c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed93 expref: 61 pid: 5847 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.904107:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:2.0:1787790785.904114:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa97750ff lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.904124:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa97750ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.904133:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa97750ff lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790785.904199:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790785.904273:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf13c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+60:2349:x1874634236584320:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 554us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790785.904293:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 82 00010000:00010000:0.0:1787790785.905177:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa97750ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.905189:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa97750ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790785.905209:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787790785.905485:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa97750f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eda8 expref: 61 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.905506:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa97750ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eda8 expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.905514:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:0.0:1787790785.905517:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787790785.905520:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981e00, rc 0) 00000100:00100000:0.0:1787790785.905978:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+60:11617:x1874634236584064:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 11313us (11621us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1787790785.905988:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 212 00000100:00100000:0.0:1787790785.909010:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790785.909117:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236584576 00000100:00100000:3.0:1787790785.909127:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236584576 00000100:00100000:3.0:1787790785.909219:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:3.0:1787790785.909237:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d80b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+60:11617:x1874634236584576:12345-192.168.201.25@tcp:103:lfs.0 00010000:00010000:3.0:1787790785.909253:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790785.909288:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa977505e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed7e expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790785.909304:0:11653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:3.0:1787790785.909308:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790785.909372:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d80b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+59:11617:x1874634236584576:12345-192.168.201.25@tcp:103:lfs.0 Request processed in 145us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790785.909378:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:3.0:1787790785.911357:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790785.911529:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236584704 00000100:00100000:0.0:1787790785.911538:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236584704 00000100:00100000:0.0:1787790785.911588:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 213 00000100:00100000:0.0:1787790785.911596:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+59:11617:x1874634236584704:12345-192.168.201.25@tcp:58:lfs.0 00010000:00010000:0.0:1787790785.911688:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa977510d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.911704:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa977510d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790785.911934:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa977510d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787790785.912142:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1787790785.912377:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+59:11617:x1874634236584704:12345-192.168.201.25@tcp:58:lfs.0 Request processed in 631us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790785.912388:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 213 00000100:00100000:2.0:1787790785.915206:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790785.915258:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236584832 00000100:00100000:1.0:1787790785.915266:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236584832 00000100:00100000:1.0:1787790785.915326:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 214 00000100:00100000:1.0:1787790785.915336:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+59:11617:x1874634236584832:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1787790785.915355:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790785.915376:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775114 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496edaf expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.915439:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa977510d lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.915446:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775114 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edaf expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.915461:0:5846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa977510d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.915470:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775114 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edaf expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.915481:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:1.0:1787790785.915483:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787790785.915486:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775114 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edaf expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790785.915491:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41479800, rc 0) 00000100:00100000:1.0:1787790785.915535:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+60:11617:x1874634236584832:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 202us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790785.915540:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 214 00010000:00010000:1.0:1787790786.304062:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787790786.373979:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787790786.373987:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787790786.374019:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787790786.374026:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787790786.374151:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf10f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874634253346432:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787790786.374260:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff931946508840 going to sleep for 11 seconds 00000100:00100000:2.0:1787790786.382336:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790786.382466:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236584960 00000100:00100000:1.0:1787790786.382476:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236584960 00000100:00100000:1.0:1787790786.382554:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 215 00000100:00100000:1.0:1787790786.382565:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+61:11618:x1874634236584960:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787790786.382595:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787790786.382703:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+61:11618:x1874634236584960:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 140us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790786.382710:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 215 00000100:00100000:3.0:1787790786.382932:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf10f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874634253346432:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00080000:2.0:1787790786.383186:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790786.386270:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790786.386382:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236585088 00000100:00100000:0.0:1787790786.386396:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236585088 00000100:00100000:0.0:1787790786.386459:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 216 00000100:00100000:0.0:1787790786.386469:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+60:11618:x1874634236585088:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787790786.386534:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa977511b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386561:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa977511b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386573:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa977511b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386589:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9775122 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386596:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9775122 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386603:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9775122 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386623:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9775129 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386643:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9775129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386649:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9775129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790786.386686:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787790786.386690:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787790786.386702:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9775129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386711:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa977511b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386717:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa977511b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386776:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa977511b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386783:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790786.386787:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa977511b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386794:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa977511b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386806:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff931a4b7e7200) 00010000:00010000:0.0:1787790786.386809:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790786.386813:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa977511b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386829:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981a00/0x70647b5fa977511b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386843:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9775122 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386849:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9775122 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386854:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9775122 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386858:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790786.386861:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9775122 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386867:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9775122 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386875:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff931a49c31e00) 00010000:00010000:0.0:1787790786.386877:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790786.386880:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9775122 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386886:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa9775122 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386900:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9775129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386907:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9775129 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386918:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9775129 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386923:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790786.386926:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9775129 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386932:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9775129 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386939:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:0.0:1787790786.386941:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790786.386944:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9775129 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.386949:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9775129 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790786.387005:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+60:11618:x1874634236585088:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 Request processed in 538us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790786.387013:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 216 00000100:00100000:3.0:1787790786.394374:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790786.396301:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236585344 00000100:00100000:1.0:1787790786.396315:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236585344 00000100:00100000:1.0:1787790786.396387:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 217 00000100:00100000:1.0:1787790786.396399:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+60:11618:x1874634236585344:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790786.396421:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790786.396444:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9775130 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496edb6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.396544:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9775137 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.396560:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9775137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.396572:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9775137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790786.396583:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787790786.396678:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9775137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.396687:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9775137 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.396693:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9775137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.396699:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790786.396715:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9775137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.396767:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9775137 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.396781:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:1.0:1787790786.396785:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787790786.396790:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9775137 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.396797:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa9775137 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.396835:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9775130 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edb6 expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.396845:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff931a4b7e7200) 00010000:00010000:1.0:1787790786.396848:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787790786.396851:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9775130 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edb6 expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.396863:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41478800, rc 0) 00000100:00100000:1.0:1787790786.396923:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+61:11618:x1874634236585344:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 525us (2558us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1787790786.396931:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 217 00000100:00100000:2.0:1787790786.402327:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790786.402427:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236585472 00000100:00100000:0.0:1787790786.402436:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236585472 00000100:00100000:0.0:1787790786.402496:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 218 00000100:00100000:0.0:1787790786.402505:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+61:11618:x1874634236585472:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787790786.402538:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787790786.402638:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+61:11618:x1874634236585472:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 134us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790786.402662:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 218 00000100:00100000:2.0:1787790786.409905:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790786.410013:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236585728 00000100:00100000:0.0:1787790786.410024:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236585728 00000100:00100000:0.0:1787790786.410088:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 219 00000100:00100000:0.0:1787790786.410098:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+61:11618:x1874634236585728:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787790786.410118:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790786.410122:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787790786.410149:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa97750d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed9a expref: 61 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.410168:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:0.0:1787790786.410173:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787790786.410187:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9775145 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496edbd expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787790786.410605:0:7920:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1787790786.410856:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa977514c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.410870:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa977514c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.410880:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa977514c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.410932:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9775145 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edbd expref: 63 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.410969:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa977514c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edbd expref: 62 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.410977:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff931a49c31e00) 00010000:00010000:0.0:1787790786.410979:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790786.410982:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981000, rc 0) 00000100:00100000:0.0:1787790786.411059:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+62:11618:x1874634236585728:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 962us (1163us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1787790786.411067:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 219 00000100:00100000:3.0:1787790786.423808:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790786.423887:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236585984 00000100:00100000:0.0:1787790786.423898:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236585984 00000100:00100000:0.0:1787790786.424015:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 220 00000100:00100000:0.0:1787790786.424026:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+62:11618:x1874634236585984:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787790786.424097:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790786.424125:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa977514c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edbd expref: 62 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.424144:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff931a49c31e00) 00010000:00010000:0.0:1787790786.424154:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787790786.424176:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa977515a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.424190:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa977515a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.424200:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa977515a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.424241:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9775161 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x4556c046 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.424249:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9775161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4556c046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.424255:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9775161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4556c046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.424327:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa977515a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.424333:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa977515a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.424339:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa977515a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.424346:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790786.424349:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa977515a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.424356:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa977515a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.424375:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:0.0:1787790786.424378:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790786.424382:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa977515a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.424387:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa977515a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.424403:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9775161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4556c046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.424408:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9775161 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4556c046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.424413:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9775161 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4556c046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.424417:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790786.424420:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9775161 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4556c046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.424425:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9775161 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4556c046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.424431:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x4556c046 (ffff931a49c31000) 00010000:00010000:0.0:1787790786.424433:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790786.424435:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9775161 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4556c046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.424440:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9775161 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4556c046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790786.424516:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+61:11618:x1874634236585984:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 492us (718us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787790786.424524:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 220 00000100:00100000:3.0:1787790786.430853:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790786.436792:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236586112 00000100:00100000:1.0:1787790786.436808:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236586112 00000100:00100000:1.0:1787790786.436882:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 221 00000100:00100000:1.0:1787790786.436893:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+61:11618:x1874634236586112:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790786.436930:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790786.436954:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9775168 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496edc4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.436992:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977516f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.437005:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977516f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.437016:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977516f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.437596:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa9775168 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edc4 expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.437617:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977516f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edc4 expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.437626:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff931a45fe6c00) 00010000:00010000:1.0:1787790786.437629:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787790786.437632:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41479e00, rc 0) 00000100:00100000:1.0:1787790786.437701:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+62:11618:x1874634236586112:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 810us (6859us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790786.437709:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 221 00000100:00100000:2.0:1787790786.442471:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790786.442748:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236586368 00000100:00100000:0.0:1787790786.442769:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236586368 00000100:00100000:0.0:1787790786.442881:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 222 00000100:00100000:0.0:1787790786.442907:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+62:11618:x1874634236586368:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787790786.442988:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9775176 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.443008:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9775176 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.443020:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9775176 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787790786.443266:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1787790786.443275:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 321323550653ns, next at 322323548418ns, rc = 0 00000004:00010000:0.0:1787790786.443376:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcb2a009 reply state 0000000093797904 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9775176 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790786.443385:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787790786.443487:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+64:11618:x1874634236586368:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 583us (1023us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1787790786.443495:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 222 00010000:00010000:1.0:1787790786.447435:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9775176 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.447455:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9775176 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.447477:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9775176 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.447483:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790786.447490:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9775176 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.447497:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9775176 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.447513:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff931a45fe6c00) 00010000:00010000:1.0:1787790786.447516:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787790786.447521:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9775176 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.447527:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980000/0x70647b5fa9775176 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790786.448908:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790786.450908:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236586496 00000100:00100000:1.0:1787790786.450924:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236586496 00000100:00100000:1.0:1787790786.451001:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 223 00000100:00100000:1.0:1787790786.451011:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+63:11618:x1874634236586496:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790786.451036:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790786.451071:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977517d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496edcb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.451142:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977517d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edcb expref: 64 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.451178:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977517d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edcb expref: 64 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.451199:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff931a45fe6c00) 00010000:00010000:1.0:1787790786.451203:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787790786.451207:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41478800, rc 0) 00000100:00100000:1.0:1787790786.451294:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+64:11618:x1874634236586496:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 275us (2384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790786.451303:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 223 00000100:00100000:3.0:1787790786.456258:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790786.456596:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236586624 00000100:00100000:1.0:1787790786.456607:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236586624 00000100:00100000:1.0:1787790786.456684:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 62 00000100:00100000:1.0:1787790786.456696:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:2348:x1874634236586624:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787790786.457004:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+10:2348:x1874634236586624:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 311us (753us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1787790786.457012:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 62 00000100:00080000:2.0:1787790786.457872:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790786.460541:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790786.460716:0:12513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236586880 00000100:00100000:1.0:1787790786.460765:0:12513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236586880 00000100:00100000:1.0:1787790786.460820:0:12513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:1.0:1787790786.460829:0:12513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+64:11618:x1874634236586880:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787790786.461041:0:12513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+65:11618:x1874634236586880:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 213us (510us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787790786.461049:0:12513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:0.0:1787790786.468003:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790786.469308:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236587136 00000100:00100000:3.0:1787790786.469430:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236587136 00000100:00100000:3.0:1787790786.469495:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 224 00000100:00100000:3.0:1787790786.469505:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931946936580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+65:11618:x1874634236587136:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787790786.469620:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931946936580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+65:11618:x1874634236587136:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 116us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790786.469641:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 224 00000100:00100000:0.0:1787790786.473163:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790786.473317:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236587264 00000100:00100000:2.0:1787790786.473342:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236587264 00000100:00100000:2.0:1787790786.473402:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 225 00000100:00100000:2.0:1787790786.473412:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ccf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+65:11618:x1874634236587264:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787790786.473432:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790786.473452:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9775184 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496edd2 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.473518:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa977518b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.473532:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa977518b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.473543:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa977518b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790786.473575:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787790786.473603:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa977518b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.473629:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa9775184 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edd2 expref: 67 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.473646:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa977518b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edd2 expref: 66 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.473653:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff931a45fe6c00) 00010000:00010000:2.0:1787790786.473656:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787790786.473660:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654fe00, rc 0) 00000100:00100000:2.0:1787790786.473712:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ccf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+66:11618:x1874634236587264:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 302us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790786.473719:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 225 00000100:00100000:2.0:1787790786.480488:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790786.480606:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236587392 00000100:00100000:1.0:1787790786.480626:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236587392 00000100:00100000:1.0:1787790786.480688:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:1.0:1787790786.480698:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+10:2347:x1874634236587392:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790786.480715:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790786.480775:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003972b842/0x70647b5fa9775192 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496edd9 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787790786.480803:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f85c2, blocks: 0x1 00010000:00010000:1.0:1787790786.480836:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=321s v=(0 0) 00010000:00010000:1.0:1787790786.480841:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790786.480851:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003972b842/0x70647b5fa9775192 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edd9 expref: 11 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.480868:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003972b842/0x70647b5fa9775192 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edd9 expref: 11 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.480880:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a41479200, rc 0) 00000100:00100000:1.0:1787790786.480930:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+11:2347:x1874634236587392:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 233us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790786.480937:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:0.0:1787790786.484081:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790786.484136:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236587648 00000100:00100000:3.0:1787790786.484157:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236587648 00000100:00100000:3.0:1787790786.484217:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 226 00000100:00100000:3.0:1787790786.484228:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53ccf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+66:11618:x1874634236587648:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787790786.484589:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53ccf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+66:11618:x1874634236587648:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 363us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790786.484595:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 226 00000100:00100000:0.0:1787790786.488092:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790786.488175:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236587776 00000100:00100000:1.0:1787790786.488183:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236587776 00000100:00100000:1.0:1787790786.488239:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:1.0:1787790786.488248:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d959a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+11:11618:x1874634236587776:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790786.488266:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790786.488283:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775199 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ede0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.488328:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003972b842/0x70647b5fa9775192 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edd9 expref: 12 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.488339:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790786.488344:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790786.488350:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775199 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ede0 expref: 12 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.488384:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003972b842/0x70647b5fa9775192 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496edd9 expref: 12 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.488396:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003972b842/0x70647b5fa9775192 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496edd9 expref: 12 pid: 6684 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790786.488409:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81239e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1874634253346560:192.168.201.25@tcp:104: 00000100:00100000:1.0:1787790786.488507:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82000 going to sleep for 11 seconds 00000100:00100000:2.0:1787790786.492907:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790786.492949:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81239e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1874634253346560:192.168.201.25@tcp:104: 00010000:00010000:1.0:1787790786.492985:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775199 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ede0 expref: 12 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.493005:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45705600, rc 0) 00000100:00100000:1.0:1787790786.493064:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d959a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+12:11618:x1874634236587776:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 4817us (4982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790786.493072:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:0.0:1787790786.493168:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236587904 00000100:00100000:0.0:1787790786.493175:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236587904 00010000:00010000:0.0:1787790786.493206:0:8498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003972b842/0x70647b5fa9775192 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496edd9 expref: 12 pid: 6684 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790786.493243:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 83 00000100:00100000:0.0:1787790786.493257:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+12:2348:x1874634236587904:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790786.493270:0:8498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790786.493290:0:8498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003972b842/0x70647b5fa9775192 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496edd9 expref: 12 pid: 6684 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.493303:0:8498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003972b842/0x70647b5fa9775192 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496edd9 expref: 12 pid: 6684 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.493338:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003972b842/0x70647b5fa9775192 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496edd9 expref: 12 pid: 6684 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.493353:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790786.493357:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790786.493365:0:8498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775199 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ede0 expref: 11 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.493376:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775199 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ede0 expref: 11 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.493404:0:8498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775199 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ede0 expref: 11 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790786.493417:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d959e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8498:1874634253346688:192.168.201.25@tcp:105: 00000100:00100000:0.0:1787790786.493477:0:8498:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a49b9c540 going to sleep for 11 seconds 00000100:00100000:2.0:1787790786.500367:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790786.500457:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236588032 00000100:00100000:1.0:1787790786.500466:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236588032 00000100:00100000:0.0:1787790786.500499:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d959e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8498:1874634253346688:192.168.201.25@tcp:105: 00002000:00100000:1.0:1787790786.500520:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff931a7be29680 x1874634236588032/t0(0) o4->3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp:627/0 lens 504/0 e 0 to 0 dl 1787790797 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787790786.500531:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a7be29680 with x1874634236588032 ext(0->12) 00010000:00010000:0.0:1787790786.500536:0:8498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1787790786.500537:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff931a7be29680 00000100:00100000:1.0:1787790786.500573:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:1.0:1787790786.500582:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be29680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+12:2349:x1874634236588032:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787790786.500649:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+12:2348:x1874634236587904:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 7391us (7751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790786.500660:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 83 00000100:00100000:1.0:1787790786.501048:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be29680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+13:2349:x1874634236588032:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 Request processed in 466us (689us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1787790786.501056:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00002000:00100000:1.0:1787790786.501062:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff931a7be29680 x1874634236588032/t4294967320(0) o4->3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp:627/0 lens 504/448 e 0 to 0 dl 1787790797 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787790786.501071:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff931a7be29680 with x1874634236588032 ext(0->12) 00002000:00010000:1.0:1787790786.501075:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff931a7be29680 00000100:00100000:1.0:1787790786.510888:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790786.511000:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236588160 00000100:00100000:2.0:1787790786.511010:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236588160 00000100:00100000:2.0:1787790786.511109:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 227 00000100:00100000:2.0:1787790786.511119:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81239e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+66:11618:x1874634236588160:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787790786.529594:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1787790786.529606:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000100:00100000:2.0:1787790786.529627:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81239e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+65:11618:x1874634236588160:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 Request processed in 18504us (18745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790786.529639:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 227 00000001:00080000:1.0:1787790786.530017:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1787790786.530029:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:1.0:1787790786.530053:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787790786.530067:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff931946508a80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1787790786.530072:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff931a492b6800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff931946508900 00000020:00080000:1.0:1787790786.530075:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff931a492b6600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff931a7d925c00 00000020:00080000:1.0:1787790786.530102:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9319465083c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1787790786.530115:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff931a492b6c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9319465086c0 00000020:00080000:1.0:1787790786.530117:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff931a492b6300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff931a7db3ac00 00000100:00100000:2.0:1787790786.530183:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be28780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253346816:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1787790786.530199:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:2.0:1787790786.530232:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790786.530271:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787790786.530277:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81239680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253346944:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787790786.530299:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790786.530325:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253346816 00000100:00100000:2.0:1787790786.530331:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253346816 00000100:00100000:2.0:1787790786.530362:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253346944 00000100:00100000:2.0:1787790786.530365:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253346944 00000020:00080000:3.0:1787790786.530377:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787790786.530390:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787790786.530397:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787790786.530399:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a79f86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1874634253346816:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787790786.530403:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1874634253346944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787790786.530420:0:6683:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00080000:2.0:1787790786.530420:0:8297:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1787790786.530443:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd6c796/0x70647b5fa97751a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787790786.530446:0:8297:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f85c1, atime: 0x6a8f85c1, ctime: 0x6a8f85c1, blocks: 0x1 00010000:00010000:2.0:1787790786.530452:0:8297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054e5fd9d/0x70647b5fa97751a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.530460:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=321s v=(0 0) 00010000:00010000:3.0:1787790786.530462:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032e900ad/0x70647b5fa9774f62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed3f expref: 12 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.530464:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790786.530470:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787790786.530471:0:8297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054e5fd9d/0x70647b5fa97751a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.530473:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787790786.530477:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cd6c796/0x70647b5fa97751a0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.530486:0:8297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054e5fd9d/0x70647b5fa97751a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.530494:0:8297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054e5fd9d/0x70647b5fa97751a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.530498:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032e900ad/0x70647b5fa9774f62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed3f expref: 12 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.530502:0:8297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054e5fd9d/0x70647b5fa97751a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.530518:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032e900ad/0x70647b5fa9774f62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed3f expref: 12 pid: 6683 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.530528:0:8297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787790786.530529:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf103c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6683:1874634253347072:192.168.201.25@tcp:104: 00000100:00100000:3.0:1787790786.530575:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4929c240 going to sleep for 11 seconds 00000100:00100000:2.0:1787790786.530972:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a79f86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3320:x1874634253346816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 573us (738us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787790786.530980:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1787790786.530999:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787790786.531008:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790786.531014:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054e5fd9d/0x70647b5fa97751a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.531022:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654fc00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:2.0:1787790786.531026:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054e5fd9d/0x70647b5fa97751a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.531034:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054e5fd9d/0x70647b5fa97751a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787790786.531035:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff931a7be28780/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787790786.531040:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be28780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253346816:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787790786.531050:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054e5fd9d/0x70647b5fa97751a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.531058:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054e5fd9d/0x70647b5fa97751a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.531075:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790786.531077:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790786.531078:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790786.531431:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8123b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253347200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787790786.531468:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790786.531494:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253347200 00000100:00100000:2.0:1787790786.531505:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253347200 00000100:00100000:2.0:1787790786.531817:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787790786.531826:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d959e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3318:x1874634253347200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787790786.531934:0:8297:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787790786.531936:0:8297:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787790786 00002000:00010000:2.0:1787790786.531938:0:8297:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787790786.531939:0:8297:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787790786 -> 1787790786 00002000:00010000:2.0:1787790786.531941:0:8297:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787790786.531976:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d959e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3318:x1874634253347200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 148us (503us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787790786.531982:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1787790786.532009:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff931a8123b840/2, rc 0, transno 4294967321 00000100:00100000:0.0:1787790786.532014:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8123b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253347200:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787790786.534502:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf103c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6683:1874634253347072:192.168.201.25@tcp:104: 00010000:00010000:3.0:1787790786.534531:0:6683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007cd6c796/0x70647b5fa97751a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790786.535686:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790786.537128:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790786.537192:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236588416 00000100:00100000:0.0:1787790786.537200:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236588416 00010000:00010000:0.0:1787790786.537242:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032e900ad/0x70647b5fa9774f62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed3f expref: 13 pid: 6683 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790786.537274:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 84 00000100:00100000:0.0:1787790786.537284:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf11a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+13:2346:x1874634236588416:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790786.537299:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790786.537304:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032e900ad/0x70647b5fa9774f62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed3f expref: 13 pid: 6683 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.537325:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032e900ad/0x70647b5fa9774f62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed3f expref: 13 pid: 6683 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.537347:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e900ad/0x70647b5fa9774f62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed3f expref: 13 pid: 6683 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.537374:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787790786.537378:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787790786.537382:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007cd6c796/0x70647b5fa97751a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.537389:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cd6c796/0x70647b5fa97751a0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.537417:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790786.537461:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf11a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+12:2346:x1874634236588416:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 178us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790786.537468:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 84 00010000:00010000:3.0:1787790786.537655:0:6683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007cd6c796/0x70647b5fa97751a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.537663:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cd6c796/0x70647b5fa97751a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.537670:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd6c796/0x70647b5fa97751a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.537675:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cd6c796/0x70647b5fa97751a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.537697:0:6683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787790786.538167:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3320:x1874634253346944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7762us (7865us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787790786.538175:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787790786.538191:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236588288 00000100:00100000:3.0:1787790786.538195:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236588288 00000004:00080000:2.0:1787790786.538207:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff931a81239680/2, rc 0, transno 4294967322 00000100:00100000:2.0:1787790786.538214:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81239680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253346944:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787790786.538221:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:3.0:1787790786.538227:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+12:2347:x1874634236588288:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1787790786.538427:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790786.538433:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cd6c796/0x70647b5fa97751a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.538439:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153a00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:0.0:1787790786.538442:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd6c796/0x70647b5fa97751a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.538449:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd6c796/0x70647b5fa97751a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.538462:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cd6c796/0x70647b5fa97751a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.538477:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cd6c796/0x70647b5fa97751a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.538491:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790786.538492:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790786.538493:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787790786.567526:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:1.0:1787790786.567702:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1787790786.567986:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2347:x1874634236588288:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 Request processed in 29751us (32300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790786.567998:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 68 00000001:00080000:1.0:1787790786.568276:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:3.0:1787790786.575028:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790786.575549:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236588672 00000100:00100000:0.0:1787790786.575559:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236588672 00000100:00100000:0.0:1787790786.575623:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 228 00000100:00100000:0.0:1787790786.575634:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+20:11618:x1874634236588672:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787790786.575689:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790786.575716:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa977518b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edd2 expref: 20 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.575788:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff931a45fe6c00) 00010000:00010000:0.0:1787790786.575794:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787790786.575828:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa97751ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.575842:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa97751ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.575851:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa97751ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790786.576094:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008771d528 reply state 0000000075dc0449 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa97751ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790786.576103:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787790786.576204:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:11618:x1874634236588672:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 572us (1187us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1787790786.576212:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 228 00010000:00010000:2.0:1787790786.581202:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa97751ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.581221:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa97751ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790786.581228:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00010000:00010000:2.0:1787790786.581229:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa97751ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.581235:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790786.581241:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa97751ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.581249:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa97751ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.581266:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff931a45fe6c00) 00010000:00010000:2.0:1787790786.581282:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790786.581288:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa97751ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.581295:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa97751ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790786.581296:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236588800 00000100:00100000:0.0:1787790786.581305:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236588800 00000100:00100000:0.0:1787790786.581357:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:0.0:1787790786.581367:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a5fc90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2348:x1874634236588800:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787790786.581609:0:8297:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787790786.581613:0:8297:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787790786 -> 1787790785 00002000:00010000:0.0:1787790786.581616:0:8297:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787790785 00002000:00010000:0.0:1787790786.581618:0:8297:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787790786 -> 1787790785 00002000:00010000:0.0:1787790786.581620:0:8297:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787790786.581682:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a5fc90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2348:x1874634236588800:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 316us (465us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1787790786.581691:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:2.0:1787790786.583634:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790786.583788:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236589056 00000100:00100000:1.0:1787790786.583797:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236589056 00000100:00100000:1.0:1787790786.583864:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 229 00000100:00100000:1.0:1787790786.583874:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d791a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+20:11618:x1874634236589056:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787790786.583940:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97751b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.583957:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977516f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edc4 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.583966:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97751b5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.583998:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977516f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496edc4 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.584012:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977516f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496edc4 expref: 20 pid: 5846 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790786.584024:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8123ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874634253347328:192.168.201.25@tcp:104: 00000100:00100000:1.0:1787790786.584098:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82300 going to sleep for 11 seconds 00000100:00100000:1.0:1787790786.590260:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8123ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874634253347328:192.168.201.25@tcp:104: 00010000:00010000:1.0:1787790786.590307:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97751b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790786.593000:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790786.593186:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236589184 00000100:00100000:3.0:1787790786.593195:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236589184 00010000:00010000:3.0:1787790786.593245:0:11653:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977516f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496edc4 expref: 21 pid: 5846 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790786.593288:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 85 00000100:00100000:3.0:1787790786.593298:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813de580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:2349:x1874634236589184:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790786.593318:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790786.593334:0:11653:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977516f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496edc4 expref: 21 pid: 5846 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.593347:0:11653:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977516f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496edc4 expref: 21 pid: 5846 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.593371:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479e00/0x70647b5fa977516f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496edc4 expref: 21 pid: 5846 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.593400:0:11653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff931a45fe6c00) 00010000:00010000:3.0:1787790786.593405:0:11653:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97751b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.593414:0:11653:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97751b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.593422:0:11653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97751b5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.593456:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790786.593512:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813de580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3e6e059d-f39a-42a8-9e93-fd30a950cc49+20:2349:x1874634236589184:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 216us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790786.593519:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 85 00010000:00010000:1.0:1787790786.593906:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97751b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.593915:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97751b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.593943:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97751b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.593950:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97751b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.593956:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97751b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.593962:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790786.593966:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97751b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.593973:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97751b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.593982:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff931a45fe6c00) 00010000:00010000:1.0:1787790786.593986:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787790786.593990:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97751b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.593996:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705800/0x70647b5fa97751b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790786.594047:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d791a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+19:11618:x1874634236589056:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 Request processed in 10174us (10432us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787790786.594055:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 229 00000100:00100000:3.0:1787790786.597503:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790786.597595:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236589312 00000100:00100000:2.0:1787790786.597604:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236589312 00000100:00100000:2.0:1787790786.597671:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:2.0:1787790786.597680:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2347:x1874634236589312:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787790786.597772:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa97751bc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.597794:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775199 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ede0 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.597803:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790786.597807:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787790786.597811:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa97751bc lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.597846:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775199 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ede0 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.597860:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775199 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ede0 expref: 8 pid: 6685 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790786.597889:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a679c30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1874634253347456:192.168.201.25@tcp:104: 00000100:00100000:2.0:1787790786.597961:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4560eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790786.601489:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a679c30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1874634253347456:192.168.201.25@tcp:104: 00010000:00010000:2.0:1787790786.601518:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa97751bc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790786.604540:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790786.605034:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236589440 00000100:00100000:0.0:1787790786.605045:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236589440 00010000:00010000:0.0:1787790786.605085:0:8498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775199 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ede0 expref: 9 pid: 6685 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790786.605131:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 86 00000100:00100000:0.0:1787790786.605140:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+9:2349:x1874634236589440:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790786.605166:0:8498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790786.605192:0:8498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775199 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ede0 expref: 9 pid: 6685 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.605206:0:8498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775199 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ede0 expref: 9 pid: 6685 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.605241:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775199 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ede0 expref: 9 pid: 6685 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.605258:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787790786.605263:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787790786.605268:0:8498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa97751bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.605279:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa97751bc lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.605321:0:8498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790786.605630:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa97751bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.605640:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa97751bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.605663:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa97751bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.605670:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa97751bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.605677:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa97751bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.605683:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654e000 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790786.605687:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa97751bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.605695:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa97751bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.605720:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa97751bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.605766:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a256869a/0x70647b5fa97751bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790786.605871:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2349:x1874634236589440:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 731us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790786.605879:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 86 00000100:00100000:1.0:1787790786.606606:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2347:x1874634236589312:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 Request processed in 8926us (9111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790786.606625:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:0.0:1787790786.610021:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790786.610109:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236589696 00000100:00100000:2.0:1787790786.610119:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236589696 00000100:00100000:2.0:1787790786.610209:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 230 00000100:00100000:2.0:1787790786.610228:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d959680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+19:11618:x1874634236589696:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787790786.610302:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa97751c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.610330:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa97751c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.610343:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa97751c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.610551:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97751ca lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.610562:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977517d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edcb expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.610569:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97751ca lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.610811:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977517d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496edcb expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.610829:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977517d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496edcb expref: 20 pid: 5846 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790786.610844:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a679c30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874634253347584:192.168.201.25@tcp:104: 00000100:00100000:2.0:1787790786.610961:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4560eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790786.614422:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790786.614515:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a679c30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874634253347584:192.168.201.25@tcp:104: 00010000:00010000:0.0:1787790786.614544:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97751ca lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790786.614633:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236589824 00000100:00100000:3.0:1787790786.614640:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236589824 00010000:00010000:3.0:1787790786.614673:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977517d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496edcb expref: 21 pid: 5846 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790786.614708:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 87 00000100:00100000:3.0:1787790786.614717:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a48e27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:2348:x1874634236589824:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790786.614775:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790786.614784:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977517d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496edcb expref: 21 pid: 5846 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.614805:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977517d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496edcb expref: 21 pid: 5846 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.614824:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478800/0x70647b5fa977517d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496edcb expref: 21 pid: 5846 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.614839:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff931a45fe6c00) 00010000:00010000:3.0:1787790786.614844:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97751ca lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.614853:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97751ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.614860:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97751ca lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.614883:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790786.614934:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a48e27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+20:2348:x1874634236589824:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 217us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790786.614942:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 87 00010000:00010000:0.0:1787790786.615030:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97751ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.615038:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97751ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787790786.615214:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1787790786.615361:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1787790786.615405:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1787790786.615498:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d95b840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874634253347712:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787790786.615542:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790786.615578:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a428a76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790786.616134:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253347712 00000100:00100000:3.0:1787790786.616141:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253347712 00000100:00100000:3.0:1787790786.616188:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787790786.616197:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d95ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1874634253347712:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787790786.616289:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d95ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1874634253347712:12345-0@lo:1000:mdt00_002.0 Request processed in 92us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790786.616296:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787790786.616533:0:5848:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1787790786.616540:0:5848:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:1.0:1787790786.616561:0:5848:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff931a8123b840, transno 4294967321 00000004:00080000:1.0:1787790786.616578:0:5848:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff931a81239680, transno 4294967322 00000100:00100000:1.0:1787790786.616585:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d95b840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874634253347712:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787790786.617096:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1787790786.617160:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8123ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874634253347840:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787790786.617197:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790786.617221:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82780 going to sleep for 11 seconds 00000100:00100000:3.0:1787790786.618302:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253347840 00000100:00100000:3.0:1787790786.618325:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253347840 00000100:00100000:3.0:1787790786.618373:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787790786.618382:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8123a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1874634253347840:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787790786.618588:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8123a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5848:x1874634253347840:12345-0@lo:1000:mdt00_002.0 Request processed in 207us (1389us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787790786.618596:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787790786.619060:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8123ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874634253347840:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787790786.619100:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97751ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.619110:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97751ca lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.619119:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97751ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.619136:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654ec00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790786.619140:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97751ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.619148:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97751ca lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.619177:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff931a45fe6c00) 00010000:00010000:1.0:1787790786.619181:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787790786.619186:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97751ca lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.619191:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ec00/0x70647b5fa97751ca lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.619223:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa977510d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.619229:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa977510d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.619235:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa977510d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.619240:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790786.619243:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa977510d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.619248:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa977510d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.619267:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:1.0:1787790786.619269:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787790786.619276:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775114 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edaf expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.619286:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775114 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edaf expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.619295:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775114 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edaf expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.619546:0:5848:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775114 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edaf expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790786.619560:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8123a580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874634253347968:192.168.201.25@tcp:105: 00000100:00100000:1.0:1787790786.619634:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff931944e82780 going to sleep for 11 seconds 00000100:00100000:1.0:1787790786.624362:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8123a580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874634253347968:192.168.201.25@tcp:105: 00010000:00010000:1.0:1787790786.624392:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa977510d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.624403:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980800/0x70647b5fa977510d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.624437:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97751d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.624453:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97751d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.624478:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97751d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.624488:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97751d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.624494:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97751d1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.624501:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97751d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.624506:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790786.624510:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97751d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.624516:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97751d1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.624527:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:1.0:1787790786.624530:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790786.624533:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97751d1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.624538:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa97751d1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.624548:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa97751c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.624554:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa97751c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.624565:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa97751c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.624570:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790786.624573:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa97751c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.624580:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa97751c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.624587:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:1.0:1787790786.624590:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787790786.624593:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa97751c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.624599:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f200/0x70647b5fa97751c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790786.624897:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d959680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:11618:x1874634236589696:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 14678us (14884us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1787790786.624907:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 230 00000020:00080000:1.0:1787790786.624913:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787790786.625893:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787790786.625901:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787790786.627283:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787790786.627297:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787790786.628909:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790786.628962:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236589952 00000100:00100000:3.0:1787790786.628973:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236589952 00000100:00100000:1.0:1787790786.629015:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790786.630173:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236590208 00000100:00100000:3.0:1787790786.630186:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236590208 00000100:00100000:3.0:1787790786.630227:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:3.0:1787790786.630236:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8123a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+24:11617:x1874634236589952:12345-192.168.201.25@tcp:49:lfs.0 00000100:00100000:3.0:1787790786.630378:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8123a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+24:11617:x1874634236589952:12345-192.168.201.25@tcp:49:lfs.0 Request processed in 142us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790786.630385:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:3.0:1787790786.630405:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 62 00000100:00100000:3.0:1787790786.630412:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a432ec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+23:11618:x1874634236590208:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787790786.632816:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:0.0:1787790786.633010:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000001:00080000:2.0:1787790786.633120:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1787790786.633123:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236590464 00000100:00100000:1.0:1787790786.633133:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236590464 00010000:00010000:2.0:1787790786.633191:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97751d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.633208:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97751d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.633221:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97751d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.633230:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97751d8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.633237:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97751d8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.633244:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97751d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.633270:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787790786.633306:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790786.633314:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97751d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.633334:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654ea00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790786.633339:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97751d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.633347:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97751d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.633360:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff931a4b7e7b00) 00010000:00010000:3.0:1787790786.633364:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787790786.633369:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97751d8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790786.633370:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a432ec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+26:11618:x1874634236590208:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 2957us (4353us total) trans 4294967514 rc 0/0 00010000:00010000:3.0:1787790786.633377:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ea00/0x70647b5fa97751d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790786.633395:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 62 00000020:00080000:2.0:1787790786.633402:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787790786.633404:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790786.633408:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790786.633410:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790786.633447:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 231 00000100:00100000:1.0:1787790786.633459:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d95a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+25:11617:x1874634236590464:12345-192.168.201.25@tcp:58:lfs.0 00000040:00080000:1.0:1787790786.633644:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787790786.633695:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d95a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+25:11617:x1874634236590464:12345-192.168.201.25@tcp:58:lfs.0 Request processed in 239us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790786.633704:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 231 00000100:00100000:1.0:1787790786.656821:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790786.656907:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236590592 00000100:00100000:3.0:1787790786.656917:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236590592 00000100:00100000:3.0:1787790786.656982:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 232 00000100:00100000:3.0:1787790786.656991:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81238780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+25:11620:x1874634236590592:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1787790786.657015:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790786.657035:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa97751df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ede7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.657099:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97751e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.657142:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97751e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.657154:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97751e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.657172:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97751ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.657179:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97751ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.657186:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97751ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.657706:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa97751f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.657718:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa97750ff lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eda8 expref: 26 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.657762:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa97751f4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.657795:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa97750ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eda8 expref: 26 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.657809:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa97750ff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eda8 expref: 26 pid: 5848 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790786.657834:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874634253348096:192.168.201.25@tcp:104: 00000100:00100000:3.0:1787790786.657904:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4929c600 going to sleep for 11 seconds 00000100:00100000:1.0:1787790786.660377:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790786.660516:0:12513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236590848 00000100:00100000:0.0:1787790786.660524:0:12513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236590848 00000100:00100000:0.0:1787790786.660571:0:12513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:0.0:1787790786.660580:0:12513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+27:5583:x1874634236590848:12345-192.168.201.25@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787790786.660813:0:12513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+28:5583:x1874634236590848:12345-192.168.201.25@tcp:35:ldlm_bl.0 Request processed in 232us (442us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787790786.660820:0:12513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:3.0:1787790786.660837:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874634253348096:192.168.201.25@tcp:104: 00010000:00010000:3.0:1787790786.660858:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa97751f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790786.663129:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790786.663245:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236590976 00000100:00100000:2.0:1787790786.663253:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236590976 00010000:00010000:2.0:1787790786.663288:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa97750ff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eda8 expref: 28 pid: 5848 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790786.663335:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 88 00000100:00100000:2.0:1787790786.663345:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d95a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+28:2348:x1874634236590976:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790786.663359:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790786.663364:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa97750ff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eda8 expref: 28 pid: 5848 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.663375:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa97750ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eda8 expref: 28 pid: 5848 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.663395:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa97750ff lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eda8 expref: 28 pid: 5848 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.663407:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:2.0:1787790786.663411:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa97751f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.663417:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa97751f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.663423:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa97751f4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.663455:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787790786.663486:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa97751f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790786.663495:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d95a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+27:2348:x1874634236590976:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 151us (384us total) trans 0 rc 0/0 00010000:00010000:3.0:1787790786.663498:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa97751f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790786.663503:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 88 00000004:00200000:3.0:1787790786.663544:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787790786.663549:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787790786.663566:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa97751f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.663577:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa97751f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.663587:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97751e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.663594:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97751e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.663600:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97751e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.663604:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790786.663614:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97751e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.663622:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97751e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.663632:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:3.0:1787790786.663635:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790786.663639:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97751e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.663645:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153e00/0x70647b5fa97751e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.663656:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97751ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.663663:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97751ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.663669:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97751ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.663675:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790786.663678:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97751ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.663683:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97751ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.663692:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff931a541ad000) 00010000:00010000:3.0:1787790786.663694:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790786.663704:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97751ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.663710:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97751ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.664591:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa97751df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ede7 expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.664611:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa97751f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ede7 expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.664619:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:3.0:1787790786.664622:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787790786.664625:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153400, rc 0) 00000100:00100000:2.0:1787790786.665003:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81238780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+26:11620:x1874634236590592:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 8011us (8190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790786.665012:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 232 00000040:00080000:0.0:1787790787.271477:0:12552:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787790787.271486:0:12552:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787790787.271541:0:12552:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787790787.271546:0:12552:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787790787.334848:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790787.500657:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790787.500793:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236591104 00000100:00100000:1.0:1787790787.500803:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236591104 00000100:00100000:1.0:1787790787.500864:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 291 00000100:00100000:1.0:1787790787.500875:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45662050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+13:2349:x1874634236591104:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790787.500956:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45662050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b956aedb-a574-46fa-b700-b912aca9a68a+13:2349:x1874634236591104:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 83us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790787.501183:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 291 00000100:00100000:1.0:1787790787.506618:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790787.506664:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790787.506700:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790787.506778:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790787.506808:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236591232 00000100:00100000:1.0:1787790787.506817:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236591232 00000100:00100000:1.0:1787790787.506862:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236591616 00000100:00100000:1.0:1787790787.506866:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236591616 00000100:00100000:1.0:1787790787.506897:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 143 00000100:00100000:1.0:1787790787.506906:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81238f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+26:2348:x1874634236591232:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790787.506981:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81238f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+26:2348:x1874634236591232:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 76us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790787.506990:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 143 00000100:00100000:1.0:1787790787.507006:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 144 00000100:00100000:1.0:1787790787.507012:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8123bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2349:x1874634236591616:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790787.507052:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8123bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2349:x1874634236591616:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 41us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790787.507060:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 144 00000100:00080000:1.0:1787790787.507081:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790787.507627:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236591360 00000100:00100000:0.0:1787790787.507633:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236591360 00000100:00100000:0.0:1787790787.507674:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236591488 00000100:00100000:0.0:1787790787.507677:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236591488 00000100:00100000:0.0:1787790787.507711:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:0.0:1787790787.507719:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81238b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2349:x1874634236591360:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790787.507791:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81238b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2349:x1874634236591360:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 73us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790787.507798:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:0.0:1787790787.507813:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 71 00000100:00100000:0.0:1787790787.507820:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a812392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2348:x1874634236591488:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790787.507843:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a812392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2348:x1874634236591488:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 24us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790787.507848:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 71 00000100:00080000:2.0:1787790787.507929:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1787790787.648150:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787790787.648158:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787790787.648189:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787790787.648194:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787790787.648300:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1b0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874634253348224:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787790787.648390:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4929c240 going to sleep for 11 seconds 00000100:00100000:1.0:1787790787.657669:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790787.657697:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1b0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1874634253348224:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787790787.657699:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236591744 00000100:00100000:1.0:1787790787.657706:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236591744 00000100:00100000:1.0:1787790787.657788:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 233 00000100:00100000:1.0:1787790787.657799:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8123b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+26:11632:x1874634236591744:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787790787.657833:0:7920:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787790787.657929:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8123b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+26:11632:x1874634236591744:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 132us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790787.657937:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 233 00000100:00100000:3.0:1787790787.662331:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790787.663076:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236592000 00000100:00100000:1.0:1787790787.663088:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236592000 00000100:00100000:1.0:1787790787.663146:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 234 00000100:00100000:1.0:1787790787.663158:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+26:11632:x1874634236592000:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790787.663182:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790787.663207:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa97751fb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496edee expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790787.663308:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9775202 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790787.663323:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9775202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790787.663346:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9775202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790787.663359:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787790787.663479:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704c00/0x70647b5fa97751fb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edee expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790787.663498:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9775202 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edee expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790787.663506:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:1.0:1787790787.663509:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787790787.663512:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45705400, rc 0) 00000100:00100000:1.0:1787790787.663568:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+28:11632:x1874634236592000:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 413us (1246us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787790787.663575:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 234 00000100:00100000:3.0:1787790787.672237:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790787.672358:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790787.672388:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236592384 00000100:00100000:3.0:1787790787.672397:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236592384 00000100:00100000:3.0:1787790787.672494:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:3.0:1787790787.672505:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+28:2349:x1874634236592384:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790787.672521:0:8498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790787.672559:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705400/0x70647b5fa9775202 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edee expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.672577:0:8498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:3.0:1787790787.672582:0:8498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790787.672623:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+27:2349:x1874634236592384:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 122us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790787.672630:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:3.0:1787790787.672717:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236592256 00000100:00100000:3.0:1787790787.672987:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236592256 00000100:00100000:3.0:1787790787.673018:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 235 00000100:00100000:3.0:1787790787.673025:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+27:11632:x1874634236592256:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787790787.673090:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9775210 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.673105:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9775210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.673114:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9775210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.673274:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9775210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.673281:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9775210 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.673288:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9775210 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.673294:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790787.673303:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9775210 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.673311:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9775210 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.673319:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:3.0:1787790787.673322:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787790787.673325:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9775210 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.673331:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa9775210 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790787.677103:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+28:11632:x1874634236592256:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 4065us (4862us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1787790787.677118:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 235 00000040:00080000:0.0:1787790787.677135:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787790787.677140:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787790787.677635:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787790787.677642:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787790787.687359:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790787.687404:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236592640 00000100:00100000:3.0:1787790787.687413:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236592640 00000100:00100000:3.0:1787790787.687467:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:3.0:1787790787.687477:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+28:11632:x1874634236592640:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787790787.687829:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+29:11632:x1874634236592640:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 353us (478us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787790787.687838:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 64 00000001:00080000:3.0:1787790787.698449:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1787790787.698469:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:3.0:1787790788.352326:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790788.676751:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253348352:0@lo:400:kworker.0 00000100:00100000:1.0:1787790788.676832:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790788.676885:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253348864:0@lo:400:kworker.0 00000100:00100000:1.0:1787790788.676912:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790788.676938:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787790788.676945:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253348736:0@lo:400:kworker.0 00000100:00100000:1.0:1787790788.676972:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790788.677007:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253348352 00000100:00100000:1.0:1787790788.677014:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253348352 00000100:00100000:1.0:1787790788.677058:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787790788.677077:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45661050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253348352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790788.677133:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45661050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253348352:12345-0@lo:400:kworker.0 Request processed in 57us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790788.677140:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787790788.678427:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253348864 00000100:00100000:1.0:1787790788.678701:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253348864 00000100:00100000:0.0:1787790788.678878:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253348736 00000100:00100000:0.0:1787790788.678884:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253348736 00000100:00100000:0.0:1787790788.678936:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787790788.678945:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8123b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1874634253348736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790788.679022:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8123b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1874634253348736:12345-0@lo:400:kworker.0 Request processed in 79us (2049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790788.679029:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1787790788.679050:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790788.679469:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787790788.679479:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8123a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253348864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790788.679522:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8123a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253348864:12345-0@lo:400:kworker.0 Request processed in 46us (2609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790788.679528:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787790788.679587:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253348736:0@lo:400:kworker.0 00000100:00100000:1.0:1787790788.679602:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253348352:0@lo:400:kworker.0 00000100:00100000:1.0:1787790788.679612:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253348864:0@lo:400:kworker.0 00000100:00080000:0.0:1787790788.679753:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790788.680173:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d80b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253348480:0@lo:400:kworker.0 00000100:00100000:3.0:1787790788.680227:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790788.680262:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253348992:0@lo:400:kworker.0 00000100:00100000:0.0:1787790788.680841:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253348480 00000100:00100000:0.0:1787790788.680848:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253348480 00000100:00100000:0.0:1787790788.680888:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787790788.680897:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a813de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253348480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790788.680946:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a813de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253348480:12345-0@lo:400:kworker.0 Request processed in 50us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790788.680953:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787790788.681767:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790788.681827:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d80b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253348480:0@lo:400:kworker.0 00000100:00100000:3.0:1787790788.681841:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790788.681849:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253348608:0@lo:400:kworker.0 00000100:00100000:3.0:1787790788.681884:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790788.681992:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253348992 00000100:00100000:1.0:1787790788.681997:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253348992 00000100:00100000:1.0:1787790788.682042:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787790788.682051:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253348992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790788.682093:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253348992:12345-0@lo:400:kworker.0 Request processed in 44us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790788.682100:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1787790788.682121:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787790788.682442:0:3320:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787790788.682449:0:3320:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1787790788.682465:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff931a7be28780, transno 4294967310 00000100:00100000:3.0:1787790788.682484:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253348992:0@lo:400:kworker.0 00000100:00100000:0.0:1787790788.687090:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253348608 00000100:00100000:0.0:1787790788.687104:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253348608 00000100:00100000:0.0:1787790788.687939:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787790788.687951:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253348608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790788.688049:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253348608:12345-0@lo:400:kworker.0 Request processed in 101us (6163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790788.688056:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787790788.688118:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253348608:0@lo:400:kworker.0 00000100:00080000:1.0:1787790788.693528:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1787790788.736510:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787790788.736520:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787790788.736554:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787790788.736560:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787790789.017782:0:12604:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787790789.017792:0:12604:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787790789.017868:0:12604:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787790789.017875:0:12604:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787790789.199067:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790789.206131:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236592896 00000100:00100000:3.0:1787790789.206149:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236592896 00000100:00100000:0.0:1787790789.208152:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 236 00000100:00100000:0.0:1787790789.208164:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d958780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+29:11652:x1874634236592896:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1787790789.208188:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790789.208209:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980600/0x70647b5fa9775217 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496edf5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790789.208302:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa977521e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790789.208317:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa977521e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790789.208344:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa977521e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790789.208356:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787790789.208473:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980600/0x70647b5fa9775217 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edf5 expref: 32 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790789.208490:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa977521e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edf5 expref: 31 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790789.208500:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:0.0:1787790789.208503:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787790789.208506:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981e00, rc 0) 00000100:00100000:0.0:1787790789.208566:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d958780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+31:11652:x1874634236592896:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 404us (9507us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787790789.208574:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 236 00000100:00080000:0.0:1787790789.208595:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790789.222310:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790789.222535:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236593024 00000100:00100000:3.0:1787790789.222545:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236593024 00000100:00100000:3.0:1787790789.222598:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 237 00000100:00100000:3.0:1787790789.222607:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81239680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+31:11652:x1874634236593024:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:3.0:1787790789.222675:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977522c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790789.222693:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977522c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790789.222715:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977522c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790789.222756:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977522c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790789.222775:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977522c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790789.222783:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977522c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790789.222790:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790789.222795:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977522c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790789.222812:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977522c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790789.222824:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:3.0:1787790789.222828:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787790789.222833:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977522c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790789.222840:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152c00/0x70647b5fa977522c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790789.222907:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81239680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+31:11652:x1874634236593024:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 301us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790789.222915:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 237 00010000:00010000:0.0:1787790789.375985:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790789.381060:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790789.381166:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236593152 00000100:00100000:2.0:1787790789.381185:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236593152 00000100:00100000:2.0:1787790789.381270:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 71 00000100:00100000:2.0:1787790789.381280:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2347:x1874634236593152:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:2.0:1787790789.381298:0:8297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790789.381319:0:8297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfd51646/0x70647b5fa9775233 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496edfc expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787790789.381345:0:8297:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8f85c1, atime: 0x6a8f85c1, ctime: 0x6a8f85c1, blocks: 0xb 00010000:00010000:2.0:1787790789.381364:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=324s v=(0 0) 00010000:00010000:2.0:1787790789.381369:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790789.381379:0:8297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfd51646/0x70647b5fa9775233 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edfc expref: 8 pid: 8297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790789.381415:0:8297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dfd51646/0x70647b5fa9775233 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edfc expref: 8 pid: 8297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790789.381429:0:8297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654f400, rc 0) 00000100:00100000:2.0:1787790789.381494:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2347:x1874634236593152:12345-192.168.201.25@tcp:101:cat.0 Request processed in 215us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790789.381502:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 71 00000100:00080000:0.0:1787790789.381569:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790789.386488:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790789.386566:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236593280 00000100:00100000:1.0:1787790789.386577:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236593280 00002000:00100000:1.0:1787790789.386638:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff93194581d2c0 x1874634236593280/t0(0) o3->3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp:630/0 lens 488/0 e 0 to 0 dl 1787790800 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787790789.386651:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93194581d2c0 with x1874634236593280 ext(0->4095) 00002000:00010000:1.0:1787790789.386657:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93194581d2c0 00000100:00100000:1.0:1787790789.386844:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:1.0:1787790789.386854:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2346:x1874634236593280:12345-192.168.201.25@tcp:3:cat.0 00000100:00100000:1.0:1787790789.387071:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+8:2346:x1874634236593280:12345-192.168.201.25@tcp:3:cat.0 Request processed in 218us (593us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787790789.387080:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00002000:00100000:1.0:1787790789.387390:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff93194581d2c0 x1874634236593280/t0(0) o3->3e6e059d-f39a-42a8-9e93-fd30a950cc49@192.168.201.25@tcp:630/0 lens 488/4536 e 0 to 0 dl 1787790800 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787790789.387400:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93194581d2c0 with x1874634236593280 ext(0->4095) 00002000:00010000:1.0:1787790789.387403:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93194581d2c0 00000100:00100000:1.0:1787790789.696002:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787790789.696026:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d95bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253349120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790789.696100:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790789.696485:0:8510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253349120 00000100:00100000:2.0:1787790789.696493:0:8510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253349120 00000100:00100000:2.0:1787790789.696579:0:8510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787790789.696590:0:8510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a812383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1874634253349120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787790789.696623:0:8510:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787790789.696677:0:8510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a812383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1874634253349120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790789.696685:0:8510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787790789.696783:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d95bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253349120:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787790790.400942:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790790.720897:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253349248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790790.720993:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790790.721716:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253349248 00000100:00100000:1.0:1787790790.721740:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253349248 00000100:00100000:1.0:1787790790.721817:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787790790.721827:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d958f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253349248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787790790.721874:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787790790.721958:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790790.722817:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d958f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253349248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 989us (1821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790790.722827:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787790790.722902:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253349248:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787790791.442248:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787790791.812147:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1787790791.812161:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1787790791.813387:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1787790791.813418:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff931944e82900 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1787790791.813423:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff931a479fed00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff931944e82300 00000020:00080000:0.0:1787790791.813437:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff931a479fe300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff931a7d948800 00000020:00080000:0.0:1787790791.813468:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1787790791.813789:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787790791.813984:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1787790792.448385:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790792.625822:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790792.625870:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790792.625898:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790792.625923:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236593408 00000100:00100000:1.0:1787790792.625925:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790792.625925:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236593792 00000100:00100000:2.0:1787790792.625931:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236593408 00000100:00100000:0.0:1787790792.625932:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236593792 00000100:00100000:1.0:1787790792.625952:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790792.626010:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236593536 00000100:00100000:3.0:1787790792.626024:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236593536 00000100:00100000:3.0:1787790792.626057:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236593920 00000100:00100000:3.0:1787790792.626059:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236593920 00000100:00100000:3.0:1787790792.626081:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 148 00000100:00100000:3.0:1787790792.626090:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8123b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:2346:x1874634236593536:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790792.626166:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8123b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:2346:x1874634236593536:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 77us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790792.626173:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 148 00000100:00100000:3.0:1787790792.626190:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 149 00000100:00100000:3.0:1787790792.626196:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2346:x1874634236593920:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790792.626218:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2346:x1874634236593920:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 22us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790792.626224:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 149 00000100:00100000:1.0:1787790792.626281:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236593664 00000100:00100000:1.0:1787790792.626285:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236593664 00000100:00100000:0.0:1787790792.630286:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 74 00000100:00100000:0.0:1787790792.630308:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81239a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2346:x1874634236593792:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790792.630409:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81239a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2346:x1874634236593792:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 109us (4537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790792.630417:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 74 00000100:00100000:0.0:1787790792.630439:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 75 00000100:00100000:0.0:1787790792.630446:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a80f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2346:x1874634236593664:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790792.630471:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a80f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2346:x1874634236593664:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 26us (4547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790792.630477:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 75 00000100:00100000:2.0:1787790792.636079:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 293 00000100:00100000:2.0:1787790792.636099:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a45662450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+13:2346:x1874634236593408:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790792.636186:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a45662450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+13:2346:x1874634236593408:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 94us (10286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790792.636204:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 293 00000100:00080000:1.0:1787790792.637259:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787790792.637266:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787790792.637269:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787790793.473794:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790793.604880:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790793.605208:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236594048 00000100:00100000:0.0:1787790793.605222:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236594048 00000100:00100000:0.0:1787790793.605296:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 238 00000100:00100000:0.0:1787790793.605308:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:11297:x1874634236594048:12345-192.168.201.25@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787790793.605465:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:11297:x1874634236594048:12345-192.168.201.25@tcp:60:lhsmtool_posix.0 Request processed in 159us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790793.605475:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 238 00000100:00100000:2.0:1787790793.609411:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790793.609608:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236594304 00000100:00100000:3.0:1787790793.609621:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236594304 00000100:00100000:3.0:1787790793.609703:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 65 00000100:00100000:3.0:1787790793.609716:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:11297:x1874634236594304:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787790793.610602:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+19:11297:x1874634236594304:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 882us (1200us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787790793.610614:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 65 00000100:00100000:1.0:1787790793.792017:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253349376:0@lo:400:kworker.0 00000100:00100000:1.0:1787790793.792123:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790793.792306:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253349760:0@lo:400:kworker.0 00000100:00100000:0.0:1787790793.792346:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790793.792389:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253349376 00000100:00100000:0.0:1787790793.792393:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253349760 00000100:00100000:2.0:1787790793.792397:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253349376 00000100:00100000:0.0:1787790793.792416:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253349760 00000100:00100000:2.0:1787790793.792456:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787790793.792465:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253349376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790793.792475:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787790793.792485:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d959e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253349760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790793.792539:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d959e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253349760:12345-0@lo:400:kworker.0 Request processed in 56us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790793.792548:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787790793.792595:0:3318:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1787790793.792601:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1787790793.792642:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253349760:0@lo:400:kworker.0 00000100:00100000:0.0:1787790793.792677:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253349504:0@lo:400:kworker.0 00000100:00100000:0.0:1787790793.792708:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790793.792749:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790793.792755:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253349632:0@lo:400:kworker.0 00000100:00100000:0.0:1787790793.792779:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790793.792809:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253349504 00000100:00100000:0.0:1787790793.792813:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253349504 00000100:00100000:0.0:1787790793.792838:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253349632 00000100:00100000:0.0:1787790793.792841:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253349632 00000100:00100000:0.0:1787790793.792861:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787790793.792867:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253349504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790793.792910:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253349504:12345-0@lo:400:kworker.0 Request processed in 42us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790793.792917:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787790793.792929:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787790793.792936:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d95b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253349632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790793.792961:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d95b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253349632:12345-0@lo:400:kworker.0 Request processed in 26us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790793.792973:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787790793.793004:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253349632:0@lo:400:kworker.0 00000100:00100000:0.0:1787790793.793012:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253349504:0@lo:400:kworker.0 00000100:00080000:0.0:1787790793.793043:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787790793.793048:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790793.793529:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787790793.793541:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253350016:0@lo:400:kworker.0 00000100:00100000:3.0:1787790793.793580:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790793.793637:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253350016 00000100:00100000:3.0:1787790793.793644:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253350016 00000100:00100000:3.0:1787790793.793688:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787790793.793695:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253350016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790793.793753:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253350016:12345-0@lo:400:kworker.0 Request processed in 58us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790793.793759:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787790793.793793:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253350016:0@lo:400:kworker.0 00000100:00080000:0.0:1787790793.793900:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787790793.793906:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787790793.793915:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1874634253349888:0@lo:400:kworker.0 00000100:00100000:0.0:1787790793.793948:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790793.794023:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253349888 00000100:00100000:3.0:1787790793.794027:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253349888 00000100:00100000:3.0:1787790793.794068:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787790793.794076:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d95a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874634253349888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790793.794121:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d95a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874634253349888:12345-0@lo:400:kworker.0 Request processed in 46us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790793.794127:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1787790793.794294:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790793.794315:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1874634253349888:0@lo:400:kworker.0 00000100:00100000:1.0:1787790793.795491:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253349376:0@lo:400:kworker.0 00000100:00100000:2.0:1787790793.795558:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253349376:12345-0@lo:400:kworker.0 Request processed in 2941us (3283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790793.795572:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787790794.038131:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790794.038310:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236594432 00000100:00100000:0.0:1787790794.038323:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236594432 00000100:00100000:0.0:1787790794.038459:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 239 00000100:00100000:0.0:1787790794.038473:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:12103:x1874634236594432:12345-192.168.201.25@tcp:101:lsof.0 00010000:00010000:0.0:1787790794.038498:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790794.038524:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa977523a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ee03 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790794.038609:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9775241 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790794.038638:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9775241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790794.038652:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9775241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790794.038944:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787790794.038949:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787790794.039032:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9775241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790794.039063:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981000/0x70647b5fa977523a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee03 expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790794.039083:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9775241 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee03 expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790794.039092:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a488be200) 00010000:00010000:0.0:1787790794.039096:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787790794.039099:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67980a00, rc 0) 00000100:00100000:0.0:1787790794.039183:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fed25c-dd19-4a75-a88a-8563aeaeed43+6:12103:x1874634236594432:12345-192.168.201.25@tcp:101:lsof.0 Request processed in 714us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790794.039192:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 239 00000100:00080000:2.0:1787790794.040458:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787790794.495931:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790794.816773:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d95b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253350144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790794.816892:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790794.817053:0:8510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253350144 00000100:00100000:2.0:1787790794.817063:0:8510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253350144 00000100:00100000:2.0:1787790794.817132:0:8510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787790794.817145:0:8510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a80d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253350144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787790794.817196:0:8510:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787790794.817255:0:8510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a80d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253350144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790794.817262:0:8510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787790794.817517:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d95b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253350144:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787790795.519987:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790795.840142:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253350272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790795.843320:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790795.844696:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253350272 00000100:00100000:1.0:1787790795.844713:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253350272 00000100:00080000:2.0:1787790795.844810:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790795.844836:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787790795.844848:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d9583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253350272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787790795.844909:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787790795.845108:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d9583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253350272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 262us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790795.845138:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787790795.846778:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253350272:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787790796.544837:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787790796.617284:0:12805:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 20:33:15 (1787790795) 00000020:00080000:0.0:1787790796.962212:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:0.0:1787790796.962238:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1787790796.962386:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787790796.962401:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1787790797.571695:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790797.742059:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790797.742113:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790797.742145:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790797.742161:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790797.742177:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790797.742210:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236594944 00000100:00100000:2.0:1787790797.742221:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236594944 00000100:00100000:0.0:1787790797.742229:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236594560 00000100:00100000:0.0:1787790797.742243:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236594560 00000100:00100000:0.0:1787790797.742286:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 295 00000100:00100000:0.0:1787790797.742294:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:2347:x1874634236594560:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790797.742296:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236594816 00000100:00100000:2.0:1787790797.742308:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236594816 00000100:00100000:2.0:1787790797.742352:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00100000:2.0:1787790797.742361:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d958f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2347:x1874634236594944:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790797.742373:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b956aedb-a574-46fa-b700-b912aca9a68a+13:2347:x1874634236594560:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 77us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790797.742381:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 295 00000100:00100000:0.0:1787790797.742415:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:0.0:1787790797.742421:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d9592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2347:x1874634236594816:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1787790797.742447:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d9592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2347:x1874634236594816:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 27us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790797.742453:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:2.0:1787790797.742470:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d958f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2347:x1874634236594944:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 109us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790797.742530:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236594688 00000100:00100000:3.0:1787790797.742534:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236594688 00000100:00100000:3.0:1787790797.742578:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236595072 00000100:00100000:3.0:1787790797.742582:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236595072 00000100:00100000:3.0:1787790797.742606:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 153 00000100:00100000:3.0:1787790797.742613:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d95b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:2347:x1874634236594688:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790797.742644:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d95b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:2347:x1874634236594688:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 34us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790797.742656:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 153 00000100:00100000:3.0:1787790797.742668:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 154 00000100:00100000:3.0:1787790797.742671:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d959a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+6:2347:x1874634236595072:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1787790797.742686:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d959a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96fed25c-dd19-4a75-a88a-8563aeaeed43+6:2347:x1874634236595072:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 15us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790797.742690:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 154 00000100:00100000:2.0:1787790797.743187:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00080000:2.0:1787790797.743209:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787790797.743214:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787790797.743217:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787790798.593377:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790798.912030:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d95b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253350528:0@lo:400:kworker.0 00000100:00100000:0.0:1787790798.912047:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81014f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253350784:0@lo:400:kworker.0 00000100:00100000:1.0:1787790798.912116:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d95bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253350400:0@lo:400:kworker.0 00000100:00100000:2.0:1787790798.912393:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790798.912459:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81017c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253351040:0@lo:400:kworker.0 00000100:00100000:2.0:1787790798.912485:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790798.912510:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787790798.912516:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d958b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253350656:0@lo:400:kworker.0 00000100:00100000:2.0:1787790798.912641:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790798.912989:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253350528 00000100:00100000:3.0:1787790798.912997:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253350528 00000100:00100000:3.0:1787790798.913057:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253350656 00000100:00100000:3.0:1787790798.913061:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253350656 00000100:00100000:3.0:1787790798.913101:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787790798.913111:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253350528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790798.913171:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253350528:12345-0@lo:400:kworker.0 Request processed in 61us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790798.913178:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787790798.913196:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787790798.913203:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53eebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253350656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790798.913229:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53eebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253350656:12345-0@lo:400:kworker.0 Request processed in 28us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790798.913235:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:3.0:1787790798.913254:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790798.913296:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d958b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253350656:0@lo:400:kworker.0 00000100:00100000:3.0:1787790798.913308:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d95b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253350528:0@lo:400:kworker.0 00000100:00100000:0.0:1787790798.916964:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790798.916965:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790798.917090:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a810143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253350912:0@lo:400:kworker.0 00000100:00100000:1.0:1787790798.917132:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790798.917204:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253351040 00000100:00100000:1.0:1787790798.917211:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253351040 00000100:00100000:1.0:1787790798.917258:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253350784 00000100:00100000:0.0:1787790798.917259:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253350912 00000100:00100000:1.0:1787790798.917262:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253350784 00000100:00100000:0.0:1787790798.917262:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253350912 00000100:00100000:0.0:1787790798.917292:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787790798.917301:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253350912:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787790798.917565:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790798.917664:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787790798.917672:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253351040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790798.917712:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253351040:12345-0@lo:400:kworker.0 Request processed in 41us (5226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790798.917720:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787790798.917760:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787790798.917767:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81016580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253350784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790798.917799:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81016580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253350784:12345-0@lo:400:kworker.0 Request processed in 33us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790798.917817:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787790798.917886:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81014f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253350784:0@lo:400:kworker.0 00000100:00100000:0.0:1787790798.917934:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253350912:12345-0@lo:400:kworker.0 Request processed in 633us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790798.917941:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787790798.917946:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a810143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253350912:0@lo:400:kworker.0 00000100:00080000:3.0:1787790798.918021:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787790798.918023:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787790798.918048:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81017c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253351040:0@lo:400:kworker.0 00000100:00100000:2.0:1787790798.918256:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253350400 00000100:00100000:2.0:1787790798.918261:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253350400 00000100:00100000:2.0:1787790798.918371:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787790798.918452:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253350400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790798.918499:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3319:x1874634253350400:12345-0@lo:400:kworker.0 Request processed in 122us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790798.918506:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787790798.918657:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d95bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253350400:0@lo:400:kworker.0 00000040:00080000:2.0:1787790798.976569:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787790798.976579:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787790798.977155:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1787790798.977170:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787790799.616821:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790799.936388:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253351168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790799.936453:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790799.939270:0:8510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253351168 00000100:00100000:0.0:1787790799.939283:0:8510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253351168 00000100:00100000:0.0:1787790799.939353:0:8510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787790799.939363:0:8510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253351168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787790799.939399:0:8510:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787790799.939491:0:8510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253351168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (3036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790799.939498:0:8510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787790799.943599:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81014b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253351168:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787790800.640194:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790800.728365:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790800.728530:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236595328 00000100:00100000:2.0:1787790800.728541:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236595328 00000100:00100000:2.0:1787790800.728615:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 66 00000100:00100000:2.0:1787790800.728626:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+18:12325:x1874634236595328:12345-192.168.201.25@tcp:35:umount.0 00000100:00080000:3.0:1787790800.728803:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790800.729404:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+19:12325:x1874634236595328:12345-192.168.201.25@tcp:35:umount.0 Request processed in 778us (1045us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787790800.729415:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 66 00000100:00100000:0.0:1787790800.734282:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790800.734377:0:12513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236595584 00000100:00100000:3.0:1787790800.734386:0:12513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236595584 00000100:00100000:3.0:1787790800.734441:0:12513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:3.0:1787790800.734450:0:12513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81014780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+19:12325:x1874634236595584:12345-192.168.201.25@tcp:35:umount.0 00000100:00100000:3.0:1787790800.734985:0:12513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81014780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3e6e059d-f39a-42a8-9e93-fd30a950cc49+20:12325:x1874634236595584:12345-192.168.201.25@tcp:35:umount.0 Request processed in 534us (709us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787790800.734994:0:12513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:3.0:1787790800.740331:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790800.740515:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236595840 00000100:00100000:0.0:1787790800.740524:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236595840 00000100:00100000:0.0:1787790800.740581:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:0.0:1787790800.740591:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a432edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+20:12325:x1874634236595840:12345-192.168.201.25@tcp:35:umount.0 00000100:00100000:0.0:1787790800.741272:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a432edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:12325:x1874634236595840:12345-192.168.201.25@tcp:35:umount.0 Request processed in 681us (949us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787790800.741281:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:1.0:1787790800.761460:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790800.762931:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236596096 00000100:00100000:2.0:1787790800.762943:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236596096 00000100:00100000:2.0:1787790800.763082:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:2.0:1787790800.763092:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:12325:x1874634236596096:12345-192.168.201.25@tcp:35:umount.0 00000100:00100000:2.0:1787790800.763516:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6e059d-f39a-42a8-9e93-fd30a950cc49+22:12325:x1874634236596096:12345-192.168.201.25@tcp:35:umount.0 Request processed in 415us (2054us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787790800.763524:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:2.0:1787790800.772001:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790800.772037:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790800.772120:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236596224 00000100:00100000:1.0:1787790800.772129:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236596224 00000100:00100000:1.0:1787790800.772181:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236596480 00000100:00100000:1.0:1787790800.772184:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236596480 00000100:00100000:1.0:1787790800.772208:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:1.0:1787790800.772216:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53eea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b956aedb-a574-46fa-b700-b912aca9a68a+14:2349:x1874634236596224:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790800.772230:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790800.772248:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a40031600/0x70647b5fa97742b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e98e expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790800.772266:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790800.772313:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53eea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b956aedb-a574-46fa-b700-b912aca9a68a+13:2349:x1874634236596224:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 98us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790800.772320:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:1.0:1787790800.772335:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:1.0:1787790800.772340:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a456d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b956aedb-a574-46fa-b700-b912aca9a68a+12:2349:x1874634236596480:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790800.772346:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790800.772363:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a4654fa00/0x70647b5fa97744a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea59 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790800.772371:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790800.772385:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a456d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b956aedb-a574-46fa-b700-b912aca9a68a+11:2349:x1874634236596480:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 46us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790800.772391:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:0.0:1787790800.777501:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790800.781981:0:11653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236596352 00000100:00100000:2.0:1787790800.781996:0:11653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236596352 00000100:00100000:2.0:1787790800.782087:0:11653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:2.0:1787790800.782098:0:11653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81014780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b956aedb-a574-46fa-b700-b912aca9a68a+11:2349:x1874634236596352:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790800.782113:0:11653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790800.782133:0:11653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a45704800/0x70647b5fa977421f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e956 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790800.782151:0:11653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790800.782230:0:11653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81014780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b956aedb-a574-46fa-b700-b912aca9a68a+10:2349:x1874634236596352:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 135us (4738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790800.782238:0:11653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:1.0:1787790800.803440:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790800.803623:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236596608 00000100:00100000:0.0:1787790800.803633:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236596608 00000100:00100000:0.0:1787790800.803700:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 72 00000100:00100000:0.0:1787790800.803710:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2345:x1874634236596608:12345-192.168.201.25@tcp:9:umount.0 00000020:00000080:0.0:1787790800.803774:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa9774591 00000100:00080000:0.0:1787790800.803783:0:6683:0:(import.c:65:import_set_state_nolock()) ffff931a49c0e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787790800.803826:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787790800.804072:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6e059d-f39a-42a8-9e93-fd30a950cc49+2:2345:x1874634236596608:12345-192.168.201.25@tcp:9:umount.0 Request processed in 353us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790800.804080:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 72 00010000:00010000:2.0:1787790800.804335:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787790800.805671:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787790800.809554:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790800.809658:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236596992 00000100:00100000:1.0:1787790800.809668:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236596992 00000100:00100000:1.0:1787790800.809775:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 73 00000100:00100000:1.0:1787790800.809786:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a810170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+7:2345:x1874634236596992:12345-192.168.201.25@tcp:9:umount.0 00000020:00000080:1.0:1787790800.809825:0:8297:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa97747f2 00000020:00010000:1.0:1787790800.809833:0:8297:0:(genops.c:1921:obd_stale_export_put()) Put export ffff931a4ae3e800: total 0 00000100:00080000:1.0:1787790800.809838:0:8297:0:(import.c:65:import_set_state_nolock()) ffff931a4ae3d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787790800.809873:0:8297:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1787790800.810156:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a810170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+5:2345:x1874634236596992:12345-192.168.201.25@tcp:9:umount.0 Request processed in 371us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790800.810164:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 73 00000020:00010000:2.0:1787790800.810518:0:5835:0:(genops.c:1907:obd_stale_export_get()) Get export ffff931a4ae3e800: total 0 00010000:00010000:2.0:1787790800.810560:0:5835:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff931a4ae3e800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787790800.810616:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa9774b95 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec2e expref: 4 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787790800.810621:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787790800.810661:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfd51646/0x70647b5fa9775233 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edfc expref: 3 pid: 8297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790800.810677:0:5835:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff931a4ae3e800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787790800.810689:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790800.810691:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790800.810693:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790800.842546:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790800.842645:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236598016 00000100:00100000:2.0:1787790800.842654:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236598016 00000100:00100000:2.0:1787790800.842708:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 240 00000100:00100000:2.0:1787790800.842718:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81014b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+22:2345:x1874634236598016:12345-192.168.201.25@tcp:39:umount.0 00000020:00000080:2.0:1787790800.842785:0:7920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa977422d 00000020:00010000:2.0:1787790800.842802:0:7920:0:(genops.c:1921:obd_stale_export_put()) Put export ffff931a81026000: total 0 00000100:00080000:2.0:1787790800.842807:0:7920:0:(import.c:65:import_set_state_nolock()) ffff931a7b876000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787790800.842843:0:7920:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1787790800.843197:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81014b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6e059d-f39a-42a8-9e93-fd30a950cc49+21:2345:x1874634236598016:12345-192.168.201.25@tcp:39:umount.0 Request processed in 480us (660us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787790800.843206:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 240 00000020:00010000:3.0:1787790800.843539:0:5834:0:(genops.c:1907:obd_stale_export_get()) Get export ffff931a81026000: total 0 00010000:00010000:3.0:1787790800.843544:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790800.843584:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff931a81026000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787790800.843615:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:3.0:1787790800.843619:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787790800.843626:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030600/0x70647b5fa9774854 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eb55 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790800.843645:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff931a49c31100) 00010000:00010000:3.0:1787790800.843647:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787790800.843658:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41478e00/0x70647b5fa97744f7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea67 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790800.843679:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:3.0:1787790800.843681:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787790800.843686:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153200/0x70647b5fa9774ef2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ed23 expref: 18 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790800.843699:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff931a488be000) 00010000:00010000:3.0:1787790800.843701:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787790800.843705:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704a00/0x70647b5fa9774567 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea83 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790800.843721:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:3.0:1787790800.843765:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787790800.843771:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a41479800/0x70647b5fa9775114 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edaf expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790800.843786:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff931a488be700) 00010000:00010000:3.0:1787790800.843789:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787790800.843792:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980400/0x70647b5fa9774c13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec51 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790800.843806:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:3.0:1787790800.843809:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787790800.843813:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705000/0x70647b5fa9774a76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ebe1 expref: 14 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790800.843825:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff931a4b7e7200) 00010000:00010000:3.0:1787790800.843833:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790800.843838:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654e400/0x70647b5fa9774513 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea6e expref: 13 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790800.843855:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a488be200) 00010000:00010000:3.0:1787790800.843857:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787790800.843861:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704e00/0x70647b5fa9774bf7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec4a expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790800.843872:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:3.0:1787790800.843874:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787790800.843877:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45704400/0x70647b5fa9774b56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec19 expref: 11 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790800.843889:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff931a488bef00) 00010000:00010000:3.0:1787790800.843891:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787790800.843894:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a45705200/0x70647b5fa9774b80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ec27 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790800.843908:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:3.0:1787790800.843910:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787790800.843914:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153400/0x70647b5fa97751f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ede7 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790800.843924:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff931a49c31700) 00010000:00010000:3.0:1787790800.843926:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787790800.843929:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981e00/0x70647b5fa977521e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496edf5 expref: 8 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790800.843954:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff931a81026000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1787790800.843977:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790800.843980:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790800.843982:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790800.960774:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253351296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790800.960859:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790800.961774:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253351296 00000100:00100000:0.0:1787790800.961784:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253351296 00000100:00100000:0.0:1787790800.961851:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787790800.961870:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253351296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787790800.961903:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787790800.962119:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787790800.962155:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253351296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 286us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790800.962162:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787790800.965225:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253351296:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787790801.663948:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787790802.055167:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:1.0:1787790802.055184:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3e6e059d-f39a-42a8-9e93-fd30a950cc49 00000001:00080000:1.0:1787790802.055192:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1787790802.055204:0:5868:0:(genops.c:885:class_export_put()) final put ffff931a81026000/3e6e059d-f39a-42a8-9e93-fd30a950cc49 00000020:00000080:1.0:1787790802.055224:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff931a81026000/3e6e059d-f39a-42a8-9e93-fd30a950cc49 for lustre-MDT0000 00000020:00000080:1.0:1787790802.055277:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff931a7b876000 for lustre-MDT0000 00000001:00100000:2.0:1787790802.068565:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3e6e059d-f39a-42a8-9e93-fd30a950cc49 00000020:00000080:2.0:1787790802.068574:0:6709:0:(genops.c:885:class_export_put()) final put ffff931a4ae3e800/3e6e059d-f39a-42a8-9e93-fd30a950cc49 00000020:00000080:3.0:1787790802.068822:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff931a4ae3e800/3e6e059d-f39a-42a8-9e93-fd30a950cc49 for lustre-OST0000 00000020:00000080:3.0:1787790802.068871:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff931a4ae3d000 for lustre-OST0000 00000100:00100000:1.0:1787790802.649633:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790802.649679:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790802.649774:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790802.649880:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236598272 00000100:00100000:0.0:1787790802.649891:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236598272 00000100:00100000:0.0:1787790802.649953:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236598144 00000100:00100000:0.0:1787790802.649956:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236598144 00000100:00100000:0.0:1787790802.649987:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236598400 00000100:00100000:0.0:1787790802.649990:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236598400 00000100:00100000:0.0:1787790802.650008:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:0.0:1787790802.650017:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b956aedb-a574-46fa-b700-b912aca9a68a+12:2349:x1874634236598272:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790802.650033:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790802.650053:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a45705c00/0x70647b5fa9774306 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9cd expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790802.650070:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790802.650124:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b956aedb-a574-46fa-b700-b912aca9a68a+11:2349:x1874634236598272:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 107us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790802.650132:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:0.0:1787790802.650150:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:0.0:1787790802.650158:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a48e27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b956aedb-a574-46fa-b700-b912aca9a68a+10:2349:x1874634236598144:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790802.650166:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790802.650175:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a45705e00/0x70647b5fa97742ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e9a3 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790802.650200:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790802.650219:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a48e27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b956aedb-a574-46fa-b700-b912aca9a68a+9:2349:x1874634236598144:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 62us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790802.650226:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:0.0:1787790802.650265:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:0.0:1787790802.650271:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf12d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b956aedb-a574-46fa-b700-b912aca9a68a+8:2349:x1874634236598400:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790802.650279:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790802.650288:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a4654e600/0x70647b5fa977449c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ea52 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790802.650297:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790802.650315:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf12d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b956aedb-a574-46fa-b700-b912aca9a68a+7:2349:x1874634236598400:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 45us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790802.650320:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:0.0:1787790802.673605:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790802.673711:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236598656 00000100:00100000:1.0:1787790802.673745:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236598656 00000100:00100000:1.0:1787790802.673825:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 241 00000100:00100000:1.0:1787790802.673850:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81014780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fed25c-dd19-4a75-a88a-8563aeaeed43+6:2345:x1874634236598656:12345-192.168.201.25@tcp:39:umount.0 00000020:00000080:1.0:1787790802.673890:0:5848:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa9774314 00000020:00010000:1.0:1787790802.673899:0:5848:0:(genops.c:1921:obd_stale_export_put()) Put export ffff931a464ee800: total 0 00000100:00080000:1.0:1787790802.673903:0:5848:0:(import.c:65:import_set_state_nolock()) ffff931a464ea000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787790802.673938:0:5848:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1787790802.674754:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81014780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96fed25c-dd19-4a75-a88a-8563aeaeed43+5:2345:x1874634236598656:12345-192.168.201.25@tcp:39:umount.0 Request processed in 876us (1127us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1787790802.674764:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 241 00000020:00010000:2.0:1787790802.675036:0:5834:0:(genops.c:1907:obd_stale_export_get()) Get export ffff931a464ee800: total 0 00010000:00010000:2.0:1787790802.675084:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff931a464ee800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787790802.675118:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a488be200) 00010000:00010000:2.0:1787790802.675122:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790802.675130:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980a00/0x70647b5fa9775241 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee03 expref: 4 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790802.675154:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff931a464ee800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787790802.675165:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790802.675168:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790802.675170:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787790802.682670:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787790802.689407:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790802.699298:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790802.699391:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236598912 00000100:00100000:2.0:1787790802.699399:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236598912 00000100:00100000:2.0:1787790802.699450:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 297 00000100:00100000:2.0:1787790802.699460:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+7:2345:x1874634236598912:12345-192.168.201.25@tcp:251:umount.0 00000020:00000080:2.0:1787790802.699512:0:5838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa977420a 00000020:00010000:2.0:1787790802.699519:0:5838:0:(genops.c:1921:obd_stale_export_put()) Put export ffff931946413000: total 0 00000100:00080000:2.0:1787790802.699523:0:5838:0:(import.c:65:import_set_state_nolock()) ffff931946412800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787790802.699624:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b956aedb-a574-46fa-b700-b912aca9a68a+3:2345:x1874634236598912:12345-192.168.201.25@tcp:251:umount.0 Request processed in 167us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790802.699630:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 297 00000020:00010000:3.0:1787790802.699763:0:5834:0:(genops.c:1907:obd_stale_export_get()) Get export ffff931946413000: total 0 00010000:00010000:3.0:1787790802.699767:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790802.699809:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff931946413000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787790802.699841:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a45704200/0x70647b5fa97742c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496e995 expref: 2 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790802.699855:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff931946413000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787790802.699864:0:5834:0:(genops.c:885:class_export_put()) final put ffff931946413000/b956aedb-a574-46fa-b700-b912aca9a68a 00010000:00010000:3.0:1787790802.699874:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790802.699875:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790802.699877:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787790802.700069:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff931946413000/b956aedb-a574-46fa-b700-b912aca9a68a for MGS 00000020:00000080:2.0:1787790802.700103:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff931946412800 for MGS 00000001:00100000:0.0:1787790803.082610:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3e6e059d-f39a-42a8-9e93-fd30a950cc49 00000020:00000080:0.0:1787790803.082624:0:7630:0:(genops.c:885:class_export_put()) final put ffff931a49c0d800/3e6e059d-f39a-42a8-9e93-fd30a950cc49 00000020:00000080:0.0:1787790803.082659:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff931a49c0d800/3e6e059d-f39a-42a8-9e93-fd30a950cc49 for lustre-OST0001 00000020:00000080:0.0:1787790803.082719:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff931a49c0e800 for lustre-OST0001 00010000:00010000:2.0:1787790803.711862:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790804.032574:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787790804.032606:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253351424:0@lo:400:kworker.0 00000100:00100000:0.0:1787790804.032708:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790804.033050:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1874634253351680:0@lo:400:kworker.0 00000100:00100000:3.0:1787790804.033090:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790804.033115:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787790804.033120:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253351552:0@lo:400:kworker.0 00000100:00100000:3.0:1787790804.033143:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790804.033162:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253352064:0@lo:400:kworker.0 00000100:00100000:3.0:1787790804.033188:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790804.033231:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253351936:0@lo:400:kworker.0 00000100:00100000:3.0:1787790804.033257:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790804.033278:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787790804.033283:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253351808:0@lo:400:kworker.0 00000100:00100000:3.0:1787790804.033305:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790804.033336:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253351680 00000100:00100000:3.0:1787790804.033345:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253351680 00000100:00100000:3.0:1787790804.033420:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253351552 00000100:00100000:3.0:1787790804.033424:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253351552 00000100:00100000:3.0:1787790804.033440:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253351936 00000100:00100000:3.0:1787790804.033443:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253351936 00000100:00100000:3.0:1787790804.033484:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787790804.033495:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874634253351680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790804.033565:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874634253351680:12345-0@lo:400:kworker.0 Request processed in 72us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790804.033573:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787790804.033595:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787790804.033602:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253351552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790804.033631:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253351552:12345-0@lo:400:kworker.0 Request processed in 31us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790804.033638:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787790804.033650:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787790804.033656:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253351936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790804.033684:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874634253351936:12345-0@lo:400:kworker.0 Request processed in 29us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790804.033690:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787790804.033717:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253352064 00000100:00100000:3.0:1787790804.033756:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253352064 00000100:00100000:3.0:1787790804.033785:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253351808 00000100:00100000:3.0:1787790804.033788:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253351808 00000100:00100000:3.0:1787790804.033805:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787790804.033812:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253352064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790804.033845:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253352064:12345-0@lo:400:kworker.0 Request processed in 34us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790804.033852:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787790804.033863:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787790804.033869:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253351808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790804.033896:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253351808:12345-0@lo:400:kworker.0 Request processed in 28us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790804.033902:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1787790804.033919:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787790804.033923:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787790804.033926:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790804.033964:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253351808:0@lo:400:kworker.0 00000100:00100000:3.0:1787790804.033977:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1874634253351936:0@lo:400:kworker.0 00000100:00100000:3.0:1787790804.034011:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253351552:0@lo:400:kworker.0 00000100:00100000:3.0:1787790804.034021:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253352064:0@lo:400:kworker.0 00000100:00100000:3.0:1787790804.034029:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1874634253351680:0@lo:400:kworker.0 00000100:00100000:1.0:1787790804.034508:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253351424 00000100:00100000:1.0:1787790804.034514:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253351424 00000100:00100000:1.0:1787790804.034670:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787790804.034680:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3318:x1874634253351424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790804.034758:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3318:x1874634253351424:12345-0@lo:400:kworker.0 Request processed in 80us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790804.034765:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787790804.036196:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253351424:0@lo:400:kworker.0 00000020:01000004:3.0:1787790804.652693:0:13008:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787790804.668698:0:13008:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787790804.668779:0:13008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f1e00/0x70647b5fa977428f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774296 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790804.668823:0:13008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f1e00/0x70647b5fa977428f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9774296 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790804.668831:0:13008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f1e00/0x70647b5fa977428f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa9774296 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790804.668839:0:13008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff931a542f1e00/0x70647b5fa977428f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa9774296 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790804.668864:0:13008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787790804.668870:0:13008:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787790804.668896:0:13008:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1787790804.668898:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787790804.668901:0:13008:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787790804.668914:0:13008:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1787790804.668917:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a542f1e00/0x70647b5fa977428f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa9774296 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790804.668933:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f1e00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:2.0:1787790804.668938:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a542f1e00/0x70647b5fa977428f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa9774296 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787790804.668942:0:13008:0:(import.c:65:import_set_state_nolock()) ffff931a7b8a1000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787790804.669068:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874634253352192:0@lo:39:umount.0 00000100:00100000:0.0:1787790804.669184:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790804.669699:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a542f1e00/0x70647b5fa977428f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x70647b5fa9774296 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790804.669711:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a542f1e00/0x70647b5fa977428f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x70647b5fa9774296 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790804.669769:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787790804.669773:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787790804.669778:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787790804.669827:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a542f1e00/0x70647b5fa977428f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa9774296 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790804.669834:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790804.669860:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a542f1e00/0x70647b5fa977428f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa9774296 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790804.669867:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a542f1e00/0x70647b5fa977428f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa9774296 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790804.669883:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790804.669885:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790804.669887:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790804.670091:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253352320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787790804.670150:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790804.670249:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253352320 00000100:00100000:0.0:1787790804.670256:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253352320 00000100:00100000:0.0:1787790804.670328:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787790804.670341:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a810143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+19:3321:x1874634253352320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790804.670359:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790804.670381:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a52848800/0x70647b5fa9774296 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70647b5fa977428f expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790804.670403:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790804.670817:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a810143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:3321:x1874634253352320:12345-0@lo:103:ldlm_bl.0 Request processed in 476us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790804.670827:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787790804.670891:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253352320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787790804.672589:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253352192 00000100:00100000:3.0:1787790804.672601:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253352192 00000100:00100000:3.0:1787790804.672666:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787790804.672676:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81017c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874634253352192:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787790804.672708:0:7920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa9774019 00000100:00080000:3.0:1787790804.672716:0:7920:0:(import.c:65:import_set_state_nolock()) ffff931a7b8a1800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787790804.672844:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81017c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3317:x1874634253352192:12345-0@lo:39:umount.0 Request processed in 169us (3660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790804.672852:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1787790804.672863:0:7920:0:(genops.c:885:class_export_put()) final put ffff931a7b8a5800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1787790804.673131:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787790804.673220:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff931a7b8a5800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787790804.673292:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff931a7b8a1800 for lustre-MDT0000 00000100:00080000:0.0:1787790804.673345:0:3317:0:(import.c:65:import_set_state_nolock()) ffff931a7b8a1000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787790804.673372:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874634253352192:0@lo:39:umount.0 00000100:00080000:2.0:1787790804.673576:0:13008:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787790804.673601:0:13008:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787790804.673607:0:13008:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787790804.679215:0:13008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa977429d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97742a4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790804.679264:0:13008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa977429d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97742a4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790804.679273:0:13008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa977429d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa97742a4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790804.679282:0:13008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa977429d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa97742a4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790804.679373:0:13008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787790804.679381:0:13008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa97741c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97741cb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790804.679389:0:13008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa97741c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97741cb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790804.679396:0:13008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa97741c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa97741cb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790804.679403:0:13008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa97741c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa97741cb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790804.682746:0:13008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787790804.682776:0:13008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa97744c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97744cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790804.682791:0:13008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa97744c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97744cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790804.682827:0:13008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa97744c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa97744cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790804.682835:0:13008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa97744c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa97744cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790804.682880:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787790804.685620:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787790804.685643:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa97741c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa97741cb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790804.685658:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479000 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:0.0:1787790804.685663:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa97741c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa97741cb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790804.685699:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa97741c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x70647b5fa97741cb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790804.685709:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa97741c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x70647b5fa97741cb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790804.685716:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787790804.685720:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787790804.685745:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787790804.685809:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa97741c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa97741cb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790804.685817:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790804.685862:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa97741c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa97741cb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790804.685870:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a41479000/0x70647b5fa97741c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa97741cb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790804.685897:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790804.685904:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa97744c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa97744cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790804.685905:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81014f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253352448:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790804.685922:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40031c00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:0.0:1787790804.685928:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa97744c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa97744cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790804.685937:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa97744c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x70647b5fa97744cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790804.686004:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790804.686078:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253352448 00000100:00100000:1.0:1787790804.686085:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253352448 10000000:00010000:0.0:1787790804.686111:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa97744c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x70647b5fa97744cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790804.686119:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787790804.686122:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1787790804.686147:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa97744c6 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa97744cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790804.686148:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1787790804.686160:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787790804.686167:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf11a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:3318:x1874634253352448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790804.686181:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa97744c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa97744cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790804.686184:0:8498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790804.686200:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790804.686202:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790804.686205:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790804.686213:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a542f1600/0x70647b5fa97741cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70647b5fa97741c4 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790804.686229:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a53eea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253352576:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787790804.686237:0:8498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787790804.686480:0:13008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787790804.686490:0:13008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a40031c00/0x70647b5fa97744c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa97744cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790804.686503:0:13008:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787790804.686513:0:13008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a41479400/0x70647b5fa9773f78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9773f7f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790804.686521:0:13008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a41479400/0x70647b5fa9773f78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9773f7f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790804.686529:0:13008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a41479400/0x70647b5fa9773f78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa9773f7f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790804.686535:0:13008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff931a41479400/0x70647b5fa9773f78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa9773f7f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790804.686546:0:13008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787790804.686550:0:13008:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1787790804.686592:0:13008:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787790804.686598:0:13008:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787790804.686603:0:13008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787790804.686611:0:13008:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:3.0:1787790804.686624:0:13008:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff931a7db59000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787790804.686631:0:13008:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9319447e5000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787790804.686639:0:13008:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff931a464ee800 96fed25c-dd19-4a75-a88a-8563aeaeed43 192.168.201.25@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787790804.686645:0:13008:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff931a44f28000) has exports, disconnecting them 00000020:00080000:3.0:1787790804.686649:0:13008:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff931a7db59000), last request at 1787790804 00000020:00000080:3.0:1787790804.686657:0:13008:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa977418c 00000100:00080000:3.0:1787790804.686680:0:13008:0:(import.c:65:import_set_state_nolock()) ffff931a7db5f000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787790804.686758:0:13008:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff931a7db59000): rc 0 00000020:00000080:3.0:1787790804.686761:0:13008:0:(genops.c:885:class_export_put()) final put ffff931a7db59000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787790804.686776:0:13008:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9319447e5000), last request at 1787790804 00000020:00000080:3.0:1787790804.686780:0:13008:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa97740c1 00000100:00080000:3.0:1787790804.686787:0:13008:0:(import.c:65:import_set_state_nolock()) ffff9319447e1800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787790804.686794:0:13008:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9319447e5000): rc 0 00000020:00000080:3.0:1787790804.686796:0:13008:0:(genops.c:885:class_export_put()) final put ffff9319447e5000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1787790804.686805:0:13008:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb49540dd3ae0 00000100:00080000:3.0:1787790804.686830:0:13008:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787790804.686835:0:13008:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1787790804.686850:0:13008:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787790804.686915:0:13008:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787790804.686933:0:13008:0:(import.c:65:import_set_state_nolock()) ffff931a7d975000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787790804.686962:0:13008:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787790804.686964:0:13008:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1787790804.686974:0:13008:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787790804.687051:0:13008:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787790804.687060:0:13008:0:(import.c:65:import_set_state_nolock()) ffff931946410800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787790804.687095:0:13008:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff931a44f28000) has no exports 00010000:00010000:2.0:1787790804.687413:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa977429d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa97742a4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790804.687424:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a52849000 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:2.0:1787790804.687427:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa977429d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa97742a4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790804.687447:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa977429d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x70647b5fa97742a4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790804.687456:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa977429d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x70647b5fa97742a4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790804.687462:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787790804.687465:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1787790804.687468:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1787790804.687493:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa977429d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa97742a4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790804.687499:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790804.687529:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa977429d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa97742a4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790804.687537:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a52849000/0x70647b5fa977429d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa97742a4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790804.687551:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790804.687555:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a41479400/0x70647b5fa9773f78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa9773f7f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790804.687570:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479400 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:2.0:1787790804.687573:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a41479400/0x70647b5fa9773f78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa9773f7f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790804.687580:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a41479400/0x70647b5fa9773f78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x70647b5fa9773f7f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790804.687587:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a41479400/0x70647b5fa9773f78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x70647b5fa9773f7f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790804.687592:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787790804.687595:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787790804.687597:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787790804.687613:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a41479400/0x70647b5fa9773f78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa9773f7f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790804.687619:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790804.687626:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a41479400/0x70647b5fa9773f78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa9773f7f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790804.687632:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a41479400/0x70647b5fa9773f78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa9773f7f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790804.687645:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790804.687647:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790804.687649:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790804.687805:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf11a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:3318:x1874634253352448:12345-0@lo:103:ldlm_bl.0 Request processed in 1636us (1802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790804.687849:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a456d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253352960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790804.687903:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787790804.687921:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790804.687943:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253352960 00000100:00100000:1.0:1787790804.687951:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253352960 00000100:00100000:3.0:1787790804.687996:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790804.688004:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253353088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787790804.688029:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790804.688483:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81014f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253352448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790804.688928:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253353088 00000100:00100000:1.0:1787790804.688937:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253353088 00000100:00100000:1.0:1787790804.688979:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787790804.688987:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:3320:x1874634253352960:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787790804.689061:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787790804.689075:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+18:3320:x1874634253353088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787790804.689092:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790804.689112:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a40031a00/0x70647b5fa9773f7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70647b5fa9773f78 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790804.689131:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790804.689179:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+17:3320:x1874634253353088:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790804.689186:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787790804.689221:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253353088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787790804.689245:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1874634253352704:0@lo:9:umount.0 00000100:00100000:3.0:1787790804.689276:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790804.689298:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1874634253352832:0@lo:9:umount.0 00000100:00100000:3.0:1787790804.689318:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790804.689347:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253352704 00000100:00100000:3.0:1787790804.689352:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253352704 00000100:00100000:3.0:1787790804.689384:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253352832 00000100:00100000:3.0:1787790804.689387:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253352832 00000100:00100000:3.0:1787790804.689407:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787790804.689414:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874634253352704:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787790804.689455:0:6685:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa977410e 00000100:00080000:3.0:1787790804.689476:0:6685:0:(import.c:65:import_set_state_nolock()) ffff931944eaa000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787790804.689520:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:1.0:1787790804.689567:0:8498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790804.689593:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a542f0e00/0x70647b5fa97742a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70647b5fa977429d expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790804.689613:0:8498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790804.689920:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:3320:x1874634253352960:12345-0@lo:103:ldlm_bl.0 Request processed in 930us (1999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790804.689929:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000020:00000080:1.0:1787790804.689977:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff931a7db59000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:3.0:1787790804.690117:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3317:x1874634253352704:12345-0@lo:9:umount.0 Request processed in 700us (836us total) trans 0 rc 0/0 00000020:00000080:1.0:1787790804.690117:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9319447e5000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1787790804.690135:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787790804.690167:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000020:00000080:1.0:1787790804.690168:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff931a7db5f000 for lustre-MDT0000 00000020:00000080:1.0:1787790804.690181:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9319447e1800 for lustre-MDT0000 00000100:00100000:3.0:1787790804.690185:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874634253352832:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787790804.690204:0:6685:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa97741f5 00000100:00080000:3.0:1787790804.690217:0:6685:0:(import.c:65:import_set_state_nolock()) ffff931a7db5c800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787790804.690231:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a456d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3320:1874634253352960:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1787790804.690237:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787790804.690465:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3317:x1874634253352832:12345-0@lo:9:umount.0 Request processed in 285us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790804.690472:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787790804.690514:0:3317:0:(import.c:65:import_set_state_nolock()) ffff931a7d975000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787790804.690540:0:3317:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787790804.690543:0:3317:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787790804.690547:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1874634253352704:0@lo:9:umount.0 00000100:00080000:3.0:1787790804.690559:0:3317:0:(import.c:65:import_set_state_nolock()) ffff931946410800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787790804.690570:0:3317:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787790804.690572:0:3317:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787790804.690575:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1874634253352832:0@lo:9:umount.0 00010000:00010000:3.0:1787790804.690605:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790804.690758:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790804.690876:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790804.691075:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253352576 00000100:00100000:3.0:1787790804.691082:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253352576 00000100:00100000:3.0:1787790804.691164:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787790804.691175:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81014f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+15:3319:x1874634253352576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787790804.691189:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790804.691209:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a4654f800/0x70647b5fa97744cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70647b5fa97744c6 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790804.691275:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790804.691319:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81014f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:3319:x1874634253352576:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790804.691326:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787790804.691376:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a53eea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3319:1874634253352576:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787790804.697167:0:13008:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff931a44f28000) has no exports 00010000:00010000:3.0:1787790804.739842:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787790804.770268:0:13008:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa9773fd3 00000020:00000080:0.0:1787790804.770285:0:13008:0:(genops.c:885:class_export_put()) final put ffff931a67cd8000/lustre-QMT0000_UUID 00000020:01000000:0.0:1787790804.770316:0:13008:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787790804.770473:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff931a67cd8000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787790804.770558:0:13008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787790804.770572:0:13008:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787790804.770577:0:13008:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff931a42f8cd28) has no exports 00000020:00000080:1.0:1787790804.775221:0:13008:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa9773fcc 00000020:00000080:1.0:1787790804.775236:0:13008:0:(genops.c:885:class_export_put()) final put ffff931a4844d000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787790804.775314:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff931a4844d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787790804.782639:0:13008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787790804.782670:0:13008:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787790804.782676:0:13008:0:(genops.c:885:class_export_put()) final put ffff931a7b874800/lustre-QMT0000_UUID 00000020:00000080:1.0:1787790804.782698:0:13008:0:(genops.c:844:class_export_destroy()) destroying export ffff931a7b874800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787790804.782710:0:13008:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1787790805.761750:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790806.784767:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787790807.159569:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 96fed25c-dd19-4a75-a88a-8563aeaeed43 00000001:00080000:2.0:1787790807.159583:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1787790807.159588:0:5868:0:(genops.c:885:class_export_put()) final put ffff931a464ee800/96fed25c-dd19-4a75-a88a-8563aeaeed43 00000020:00000080:3.0:1787790807.159683:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff931a464ee800/96fed25c-dd19-4a75-a88a-8563aeaeed43 for lustre-MDT0000 00000020:00000080:3.0:1787790807.159769:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff931a464ea000 for lustre-MDT0000 00000001:00100000:2.0:1787790807.170004:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787790807.170016:0:6709:0:(genops.c:885:class_export_put()) final put ffff931944ea8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787790807.170094:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff931944ea8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787790807.170144:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff931944eaa000 for lustre-OST0000 00010000:00010000:2.0:1787790807.808038:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787790808.180682:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787790808.180690:0:7630:0:(genops.c:885:class_export_put()) final put ffff931a7db5a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787790808.180797:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff931a7db5a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787790808.180845:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff931a7db5c800 for lustre-OST0001 00010000:00010000:3.0:1787790808.832897:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790809.152046:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253353216:0@lo:400:kworker.0 00000100:00100000:1.0:1787790809.152115:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1874634253353344:0@lo:400:kworker.0 00000100:00100000:0.0:1787790809.152125:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790809.152196:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253353216 00000100:00100000:3.0:1787790809.152216:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253353216 00000100:00100000:3.0:1787790809.152265:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787790809.152274:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a42fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:3318:x1874634253353216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790809.152310:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1874634253353472:0@lo:400:kworker.0 00000100:00100000:3.0:1787790809.155236:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a42fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21+14:3318:x1874634253353216:12345-0@lo:400:kworker.0 Request processed in 2953us (3100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790809.155250:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1787790809.155578:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253353216:0@lo:400:kworker.0 00000100:00100000:2.0:1787790809.158296:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790809.158391:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253353472 00000100:00100000:3.0:1787790809.158400:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253353472 00000100:00100000:3.0:1787790809.158438:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787790809.158446:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3320:x1874634253353472:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787790809.158456:0:5848:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787790809.158515:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3320:x1874634253353472:12345-0@lo:400:kworker.0 Request processed in 68us (226us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787790809.158535:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:2.0:1787790809.158682:0:3320:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787790809.158689:0:3320:0:(import.c:65:import_set_state_nolock()) ffff93194645c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787790809.158693:0:3320:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1787790809.168391:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790809.172147:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253353344 00000100:00100000:3.0:1787790809.172234:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253353344 00000100:00100000:3.0:1787790809.172382:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787790809.172390:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3319:x1874634253353344:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787790809.172400:0:5847:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787790809.173136:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3319:x1874634253353344:12345-0@lo:400:kworker.0 Request processed in 741us (4748us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787790809.173146:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1787790809.173403:0:3319:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787790809.173409:0:3319:0:(import.c:65:import_set_state_nolock()) ffff931a7c0a9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787790809.173413:0:3319:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787790809.173418:0:3319:0:(import.c:65:import_set_state_nolock()) ffff931a7c0a9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787790809.173422:0:3319:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 148 00000100:00080000:1.0:1787790809.173429:0:3319:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff931a7c0a9800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:1.0:1787790809.174077:0:3319:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931a7bf130c0 x1874634253353600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787790809.174105:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1874634253353344:0@lo:400:kworker.0 00000100:00100000:0.0:1787790809.174445:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1874634253353600:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1787790809.174599:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790809.175090:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253353600 00000100:00100000:3.0:1787790809.175098:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253353600 00000100:00100000:3.0:1787790809.175132:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787790809.175139:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a53eea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3317:x1874634253353600:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1787790809.175157:0:5848:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787790809.187954:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a53eea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3317:x1874634253353600:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 12806us (13348us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787790809.187968:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1787790809.188611:0:3317:0:(import.c:65:import_set_state_nolock()) ffff931a7c0a9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787790809.188620:0:3317:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787790809.188625:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1874634253353600:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1787790809.192226:0:3320:0:(import.c:65:import_set_state_nolock()) ffff93194645c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787790809.192240:0:3320:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 164 00000100:00080000:2.0:1787790809.192250:0:3320:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93194645c800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:2.0:1787790809.192318:0:3320:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931a7befc780 x1874634253353728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787790809.192345:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1874634253353472:0@lo:400:kworker.0 00000100:00100000:0.0:1787790809.193294:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1874634253353728:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787790809.193384:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790809.195298:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253353728 00000100:00100000:2.0:1787790809.195311:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253353728 00000100:00100000:2.0:1787790809.195377:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787790809.195385:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3317:x1874634253353728:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1787790809.195404:0:7920:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787790809.195497:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3317:x1874634253353728:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 111us (2112us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787790809.195523:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1787790809.195681:0:3317:0:(import.c:65:import_set_state_nolock()) ffff93194645c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787790809.195687:0:3317:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787790809.195692:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1874634253353728:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:2.0:1787790809.855987:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787790810.815899:0:13008:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff931a44f804e0 - data ffff931944887000/ffff931944748000 00000020:01000000:1.0:1787790810.816035:0:13008:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff931a64432a80 - data ffff931a718d31b0/ffff931a7d84e800 00000001:00000004:1.0:1787790810.821462:0:13008:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:3.0:1787790810.886682:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787790810.934297:0:13008:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787790810.934306:0:13008:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1787790810.934410:0:13008:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787790810.934426:0:13008:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787790810.938237:0:6790:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787790810.938247:0:6790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1787790810.938258:0:6790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1787790810.946880:0:13008:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787790810.947004:0:13008:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1787790810.947026:0:13008:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787790810.947028:0:13008:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787790810.948511:0:7918:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787790810.948518:0:7918:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1787790810.948530:0:7918:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787790811.042362:0:13008:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa9773f9b 00000020:00000080:2.0:1787790811.042375:0:13008:0:(genops.c:885:class_export_put()) final put ffff931a81160800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787790811.043442:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff931a81160800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787790811.044531:0:13008:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa9773fb0 00000020:00000080:2.0:1787790811.044541:0:13008:0:(genops.c:885:class_export_put()) final put ffff931a5ffcd000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787790811.044594:0:13008:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787790811.044601:0:13008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787790811.044610:0:13008:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787790811.044614:0:13008:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff931a44f2cd28) has no exports 00000004:01000000:2.0:1787790811.044802:0:13008:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787790811.044811:0:13008:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa97741ee 00000020:00000080:2.0:1787790811.044815:0:13008:0:(genops.c:885:class_export_put()) final put ffff931946415800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787790811.052862:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff931a5ffcd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787790811.054111:0:13008:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787790811.054247:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff931946415800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787790811.054367:0:13008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787790811.054381:0:13008:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787790811.054390:0:13008:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff931a7dc9cd28) has no exports 00000020:00000080:2.0:1787790811.054400:0:13008:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa97741e7 00000020:00000080:2.0:1787790811.054408:0:13008:0:(genops.c:885:class_export_put()) final put ffff931946410000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787790811.054472:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff931946410000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787790811.056421:0:13008:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787790811.056430:0:13008:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787790811.056434:0:13008:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1787790811.056441:0:13008:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787790811.056443:0:13008:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787790811.056481:0:13008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787790811.056501:0:13008:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787790811.056511:0:13008:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa9774107 00000020:00000080:2.0:1787790811.056520:0:13008:0:(genops.c:885:class_export_put()) final put ffff931a7d977000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787790811.056526:0:13008:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787790811.056530:0:13008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787790811.056535:0:13008:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787790811.056539:0:13008:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff931a42f88000) has no exports 00000020:00000080:2.0:1787790811.056545:0:13008:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa9774100 00000020:00000080:2.0:1787790811.056548:0:13008:0:(genops.c:885:class_export_put()) final put ffff931a7d973000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787790811.056673:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff931946410800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787790811.056681:0:37:0:(genops.c:885:class_export_put()) final put ffff9319447e4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787790811.056685:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9319447e4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787790811.056694:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787790811.056807:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff931a7d977000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787790811.056819:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff931a7d973000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787790811.059664:0:13008:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787790811.059674:0:13008:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787790811.059678:0:13008:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1787790811.059686:0:13008:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787790811.059689:0:13008:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787790811.059758:0:13008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787790811.059768:0:13008:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787790811.059814:0:13008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787790811.059819:0:13008:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787790811.059821:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff931a7d975000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787790811.059826:0:13008:0:(genops.c:885:class_export_put()) final put ffff931a81165800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787790811.059831:0:13008:0:(genops.c:844:class_export_destroy()) destroying export ffff931a81165800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1787790811.059832:0:37:0:(genops.c:885:class_export_put()) final put ffff931a7b875000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787790811.059836:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff931a7b875000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787790811.059838:0:13008:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787790811.059842:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787790811.060806:0:13008:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa9773fb7 00000020:00000080:2.0:1787790811.060818:0:13008:0:(genops.c:885:class_export_put()) final put ffff931a5ffcb000/lustre-MDD0000_UUID 00000020:01000000:2.0:1787790811.060832:0:13008:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787790811.060838:0:13008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787790811.060845:0:13008:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787790811.060849:0:13008:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff931a44f299b8) has no exports 00000020:00000080:3.0:1787790811.060867:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff931a5ffcb000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787790811.060872:0:13008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787790811.060878:0:13008:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787790811.061131:0:13008:0:(genops.c:885:class_export_put()) final put ffff931a81164000/lustre-MDD0000_UUID 00000020:00000080:2.0:1787790811.061136:0:13008:0:(genops.c:844:class_export_destroy()) destroying export ffff931a81164000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787790811.061143:0:13008:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1787790811.061764:0:13008:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa9773fbe 00000020:00000080:2.0:1787790811.061772:0:13008:0:(genops.c:885:class_export_put()) final put ffff931a5ffcc800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787790811.062353:0:13008:0:(tgt_mount.c:187:server_put_mount()) put mount ffff931a4977d000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787790811.062360:0:13008:0:(obd_mount.c:710:lustre_put_lsi()) put ffff931a4977d000 3 00000020:01000004:1.0:1787790811.062364:0:13008:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff931a4977d000 from lustre-MDT0000 00000020:00000080:1.0:1787790811.062391:0:13008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787790811.062400:0:13008:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787790811.062403:0:13008:0:(genops.c:885:class_export_put()) final put ffff931a81160000/lustre-MDT0000_UUID 00000020:00000080:1.0:1787790811.062407:0:13008:0:(genops.c:844:class_export_destroy()) destroying export ffff931a81160000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787790811.062422:0:13008:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787790811.062469:0:13008:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1787790811.062473:0:13008:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787790811.062477:0:13008:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787790811.062481:0:13008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787790811.062485:0:13008:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787790811.062491:0:13008:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff931a46469800 e4f5edb7-fc08-421f-83d8-e03ffbb6fa21 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787790811.062497:0:13008:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff931a42f8b370) has exports, disconnecting them 00000020:00080000:1.0:1787790811.062502:0:13008:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff931a46469800), last request at 1787790595 00000020:00000080:1.0:1787790811.062518:0:13008:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa9773f5c 00000020:00010000:1.0:1787790811.062523:0:13008:0:(genops.c:1921:obd_stale_export_put()) Put export ffff931a46469800: total 1 00000100:00080000:1.0:1787790811.062526:0:13008:0:(import.c:65:import_set_state_nolock()) ffff931a4646b000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787790811.062544:0:13008:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff931a46469800): rc 0 00000020:00080000:1.0:1787790811.062549:0:13008:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff931a42f8b370) has no exports 00000020:00010000:2.0:1787790811.062612:0:5834:0:(genops.c:1907:obd_stale_export_get()) Get export ffff931a46469800: total 1 00000100:00100000:0.0:1787790811.062639:0:5840:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff931a4658a600:5840] 1 exiting: rc = 0 00010000:00010000:2.0:1787790811.062646:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff931a46469800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1787790811.062680:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a52849800/0x70647b5fa9774074 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70647b5fa977406d expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790811.062707:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a52848a00/0x70647b5fa97742b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70647b5fa97742ab expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790811.062743:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a4654e800/0x70647b5fa97744b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70647b5fa97744aa expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790811.062758:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a82152600/0x70647b5fa97744bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70647b5fa97744b8 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790811.062770:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a45705a00/0x70647b5fa977425e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70647b5fa9774257 expref: 5 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790811.062794:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a542f0000/0x70647b5fa9774288 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70647b5fa9774281 expref: 4 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790811.062807:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a40030200/0x70647b5fa977426c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70647b5fa9774265 expref: 3 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790811.062818:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a52849400/0x70647b5fa977427a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70647b5fa9774273 expref: 2 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790811.062828:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff931a46469800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1787790811.062843:0:5834:0:(genops.c:885:class_export_put()) final put ffff931a46469800/e4f5edb7-fc08-421f-83d8-e03ffbb6fa21 00000020:00000080:3.0:1787790811.063045:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff931a5ffcc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1787790811.063079:0:5838:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff931a46588200:5838] 0 exiting: rc = 1 00000100:00100000:3.0:1787790811.063138:0:5841:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff931a492cec00:5841] 2 exiting: rc = 0 00000100:00100000:1.0:1787790811.063382:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1787790811.063387:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790811.063393:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063402:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1787790811.063403:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790811.063407:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790811.063413:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063421:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063426:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787790811.063435:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff931a46469800/e4f5edb7-fc08-421f-83d8-e03ffbb6fa21 for MGS 00000100:00100000:1.0:1787790811.063443:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063452:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063458:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063464:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063471:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063478:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063484:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063491:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063499:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063512:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063520:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063526:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063532:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787790811.063535:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff931a4646b000 for MGS 00000100:00100000:1.0:1787790811.063542:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063552:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063558:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063563:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063568:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063573:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063578:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063583:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063588:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063594:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063598:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063604:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063608:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063613:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063618:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063623:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063628:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063633:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063637:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063642:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063647:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063652:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063665:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063670:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063675:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063680:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063686:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063691:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063696:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063701:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063706:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063711:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063716:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063799:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063805:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063812:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063818:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063824:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063830:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063836:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063841:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063847:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063855:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063862:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.063870:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1787790811.064314:0:13008:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787790811.064318:0:13008:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1787790811.068682:0:13008:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff931a7c273b40 - data ffff931a7ff4de58/ffff931a679a0800 00000020:01000000:1.0:1787790811.068825:0:13008:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff931a467f8960 - data ffff931a74fd0438/ffff931a4888fc00 00000020:00000080:1.0:1787790811.069296:0:13008:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa9773f40 00000020:00000080:1.0:1787790811.069305:0:13008:0:(genops.c:885:class_export_put()) final put ffff931a463e3000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787790811.069334:0:13008:0:(tgt_mount.c:187:server_put_mount()) put mount ffff931a4977d000 from MGS, refs=2 00000020:01000004:1.0:1787790811.069338:0:13008:0:(obd_mount.c:710:lustre_put_lsi()) put ffff931a4977d000 2 00000020:01000004:1.0:1787790811.069341:0:13008:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff931a4977d000 from MGS 00000020:00000080:3.0:1787790811.069357:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff931a463e3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787790811.069363:0:13008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787790811.069371:0:13008:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787790811.069385:0:13008:0:(genops.c:885:class_export_put()) final put ffff931a463e1000/MGS 00000020:00000080:1.0:1787790811.069388:0:13008:0:(genops.c:844:class_export_destroy()) destroying export ffff931a463e1000/MGS for MGS 00000020:01000000:1.0:1787790811.069395:0:13008:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787790811.069451:0:13008:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787790811.069455:0:13008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787790811.069461:0:13008:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787790811.069468:0:13008:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff931a7b8a7000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787790811.069475:0:13008:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff931a493c3370) has exports, disconnecting them 00000020:00080000:1.0:1787790811.069479:0:13008:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff931a7b8a7000), last request at 1787790596 00000020:00000080:1.0:1787790811.069483:0:13008:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa977400b 00000020:00080000:1.0:1787790811.069494:0:13008:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff931a7b8a7000): rc 0 00000020:00000080:1.0:1787790811.069498:0:13008:0:(genops.c:885:class_export_put()) final put ffff931a7b8a7000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787790811.069531:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff931a7b8a7000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787790811.079857:0:13008:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787790811.079867:0:13008:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787790811.079871:0:13008:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787790811.079878:0:13008:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787790811.080425:0:13008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787790811.080435:0:13008:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787790811.080443:0:13008:0:(obd_mount.c:710:lustre_put_lsi()) put ffff931a4977d000 1 00000020:00000080:2.0:1787790811.080450:0:13008:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa9773f32 00000020:00000080:2.0:1787790811.080460:0:13008:0:(genops.c:885:class_export_put()) final put ffff931a463e2800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787790811.080517:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff931a7b8a1000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787790811.080525:0:37:0:(genops.c:885:class_export_put()) final put ffff931a7b8a3000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787790811.080528:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff931a7b8a3000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787790811.080535:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1787790811.080688:0:13008:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787790811.080694:0:13008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787790811.080699:0:13008:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787790811.080704:0:13008:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff931a493c19b8) has no exports 00000020:00000080:3.0:1787790811.083119:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff931a463e2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787790811.127398:0:13008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787790811.127414:0:13008:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787790811.127420:0:13008:0:(genops.c:885:class_export_put()) final put ffff931a49355000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787790811.127424:0:13008:0:(genops.c:844:class_export_destroy()) destroying export ffff931a49355000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787790811.127432:0:13008:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787790811.127562:0:13008:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff931a49357000 00000020:01000000:1.0:1787790811.127585:0:13008:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787790811.127589:0:13008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787790811.127593:0:13008:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787790811.127598:0:13008:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff931a44f2b370) has no exports 00000100:00100000:2.0:1787790811.128499:0:7920:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff931a45742200:7920] 3 exiting: rc = 0 00000100:00100000:0.0:1787790811.128989:0:5846:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff931a429e3a00:5846] 0 exiting: rc = 1 00000100:00100000:0.0:1787790811.129057:0:5847:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff931a429e3400:5847] 1 exiting: rc = 0 00000100:00100000:2.0:1787790811.136116:0:5848:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff931a429e2800:5848] 2 exiting: rc = 0 00000100:00100000:1.0:1787790811.136591:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136599:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136605:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136612:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136625:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136632:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136638:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136654:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136662:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136668:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136686:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136692:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136700:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136707:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136712:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136719:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136754:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136760:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136766:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136772:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136952:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136961:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136967:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136972:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136978:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136983:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136989:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.136994:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137000:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137006:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137012:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137018:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137024:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137029:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137035:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137040:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137046:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137051:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137057:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137062:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137068:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137075:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137081:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137086:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137093:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137109:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137115:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137120:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137125:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137130:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137137:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137143:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137148:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137154:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137159:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137164:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137170:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137176:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137180:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137186:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137192:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137197:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137202:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.137207:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790811.145970:0:12513:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff931a5fda7a00:12513] 2 exiting: rc = 0 00000100:00100000:2.0:1787790811.146125:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff931a42800e00:5850] 1 exiting: rc = 0 00000100:00100000:0.0:1787790811.146142:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff931a429e3200:5849] 0 exiting: rc = 1 00000100:00100000:1.0:1787790811.146341:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146352:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146363:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146376:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146387:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146395:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146406:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146416:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146421:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146428:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146434:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146440:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146499:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146505:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146513:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146520:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146540:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146547:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146555:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146562:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146570:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146577:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146585:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146593:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146600:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146607:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146613:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146621:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146627:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146635:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146641:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146648:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146656:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146666:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146676:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146686:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146691:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146703:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146707:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146713:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.146719:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.147715:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.147766:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.147775:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.147865:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.147878:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.147958:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.147964:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.147969:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.147973:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.147978:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.147993:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.148005:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.148011:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.148019:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.148024:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.148029:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.148036:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.148041:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.148046:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.148050:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.148054:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.148059:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.148063:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790811.149210:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff931a44ef0e00:5851] 0 exiting: rc = 1 00000100:00100000:3.0:1787790811.149606:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff931a44ef0c00:5852] 1 exiting: rc = 0 00000100:00100000:1.0:1787790811.149993:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150003:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150020:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150031:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150040:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150049:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150058:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150084:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150095:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150102:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150113:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150121:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150178:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150186:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150193:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150199:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150204:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150210:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150217:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150251:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150261:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150268:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150289:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150298:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150305:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150314:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150331:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150345:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150355:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150364:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150375:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150410:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150420:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150434:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150441:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150446:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150452:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150458:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150465:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150472:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150478:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150485:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150539:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150561:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150568:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150575:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150581:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150587:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150592:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150598:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150604:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150609:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150615:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150622:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150628:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150650:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150657:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150670:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150675:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150681:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150686:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150693:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150699:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.150714:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.173124:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff931a44f3c200:5854] 1 exiting: rc = 0 00000100:00100000:0.0:1787790811.174222:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff931a44f83000:5853] 0 exiting: rc = 1 00000100:00100000:1.0:1787790811.174377:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174386:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174394:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174404:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174413:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174422:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174431:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174437:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174445:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174454:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174464:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174472:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174480:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174484:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174489:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174493:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174498:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174503:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174508:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174512:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174517:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174523:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174528:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174533:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174538:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174543:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174548:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174564:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174569:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174574:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174580:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174585:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174589:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174594:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174599:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174604:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174609:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174614:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.174619:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175168:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175180:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175185:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175191:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175195:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175200:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175206:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175211:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175216:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175221:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175226:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175230:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175235:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175243:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175250:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175258:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175275:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175283:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175291:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175299:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175306:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175313:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175328:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175476:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.175486:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.176602:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff931a44f82400:5856] 1 exiting: rc = 0 00000100:00100000:2.0:1787790811.176776:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff931a44f83c00:5855] 0 exiting: rc = 1 00000100:00100000:1.0:1787790811.177491:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177501:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177506:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177511:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177516:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177521:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177526:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177531:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177536:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177542:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177547:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177552:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177557:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177562:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177568:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177573:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177578:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177584:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177589:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177595:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177600:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177605:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177610:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177615:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.177619:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178103:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178114:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178119:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178124:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178129:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178135:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178140:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178157:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178161:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178167:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178172:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178177:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178182:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178187:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178192:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178199:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178204:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178209:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178214:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178220:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178224:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178229:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178234:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178239:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178245:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178251:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178256:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.178261:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.183097:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.183125:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.183137:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.183148:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.183159:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.183169:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.183180:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.183190:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.183201:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.183212:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790811.183223:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.187160:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff931a71634a00:5857] 0 exiting: rc = 1 00000100:00100000:2.0:1787790811.187182:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff931a71635200:5858] 1 exiting: rc = 0 00000100:00100000:0.0:1787790811.189495:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189505:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189510:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189516:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189521:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189527:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189695:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189702:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189707:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189713:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189719:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189836:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189842:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189847:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189852:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189857:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189879:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189884:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189890:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189894:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189899:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189905:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189911:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189916:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189920:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189925:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189930:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189935:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189940:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189945:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189951:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189956:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189961:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189966:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189971:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189976:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189981:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189986:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189991:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.189996:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190002:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190006:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190011:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190016:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190022:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190027:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190031:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190036:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190041:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190047:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190052:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190067:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190073:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190081:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190087:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190092:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190097:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190102:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190107:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190111:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190116:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190120:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190125:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.190130:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790811.191660:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff931a71635000:5861] 2 exiting: rc = 0 00000100:00100000:1.0:1787790811.191757:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff931a71634600:5860] 1 exiting: rc = 0 00000100:00100000:2.0:1787790811.192772:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff931a716a5a00:5859] 0 exiting: rc = 1 00000100:00100000:0.0:1787790811.193199:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193208:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193234:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193241:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193246:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193252:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193259:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193268:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193277:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193286:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193293:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193299:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193305:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193311:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193315:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193345:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193353:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193368:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193375:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193380:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193386:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193391:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193407:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193412:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193417:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193423:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193442:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193448:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193453:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193458:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193464:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193469:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193474:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193480:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193485:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193491:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193496:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193502:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193507:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193512:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193517:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193523:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193528:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193533:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193539:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193544:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193549:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193554:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193558:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193563:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193584:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193591:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193596:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193601:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193606:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193612:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193618:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193645:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193651:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193657:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193662:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193668:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193674:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790811.193680:0:13008:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787790811.201580:0:13008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787790811.201594:0:13008:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787790811.201601:0:13008:0:(genops.c:885:class_export_put()) final put ffff931a79fc5000/MDS_uuid 00000020:00000080:2.0:1787790811.201605:0:13008:0:(genops.c:844:class_export_destroy()) destroying export ffff931a79fc5000/MDS_uuid for MDS 00000020:01000000:2.0:1787790811.201614:0:13008:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787790811.202181:0:13008:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1787790811.903939:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790812.928810:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790813.952167:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787790814.248827:0:13162:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787790814.260207:0:13162:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787790814.260257:0:13162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f0800/0x70647b5fa9774273 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977427a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790814.260282:0:13162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f0800/0x70647b5fa9774273 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa977427a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790814.260305:0:13162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a542f0800/0x70647b5fa9774273 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa977427a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790814.260312:0:13162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff931a542f0800/0x70647b5fa9774273 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa977427a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790814.260335:0:13162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787790814.260341:0:13162:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787790814.260364:0:13162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787790814.260369:0:13162:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787790814.260375:0:13162:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787790814.260382:0:13162:0:(import.c:65:import_set_state_nolock()) ffff931a7c0a9800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787790814.260387:0:13162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787790814.260389:0:13162:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787790814.260392:0:13162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787790814.261061:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790814.261071:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a542f0800/0x70647b5fa9774273 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa977427a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790814.261080:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f0800 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:0.0:1787790814.261084:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a542f0800/0x70647b5fa9774273 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa977427a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790814.261094:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a542f0800/0x70647b5fa9774273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x70647b5fa977427a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790814.261101:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a542f0800/0x70647b5fa9774273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x70647b5fa977427a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790814.261108:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787790814.261111:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787790814.261113:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787790814.261148:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a542f0800/0x70647b5fa9774273 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa977427a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790814.261154:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790814.261190:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a542f0800/0x70647b5fa9774273 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa977427a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790814.261210:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a542f0800/0x70647b5fa9774273 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa977427a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790814.261227:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790814.261229:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790814.261231:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790814.261240:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be19e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253353856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790814.261594:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790814.261812:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253353856 00000100:00100000:0.0:1787790814.261819:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253353856 00000100:00100000:0.0:1787790814.261861:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787790814.261869:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a48e25450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3321:x1874634253353856:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787790814.261876:0:5831:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787790814 with bad export cookie 8098733680714268508 00010000:00010000:3.0:1787790814.264512:0:13162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40030400/0x70647b5fa9774281 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9774288 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790814.264530:0:13162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40030400/0x70647b5fa9774281 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9774288 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790814.264538:0:13162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40030400/0x70647b5fa9774281 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa9774288 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790814.264545:0:13162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff931a40030400/0x70647b5fa9774281 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa9774288 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790814.264573:0:13162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787790814.264594:0:13162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa97744b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97744bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790814.264601:0:13162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa97744b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97744bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790814.264607:0:13162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa97744b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa97744bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790814.264613:0:13162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa97744b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa97744bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790814.264624:0:13162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787790814.264628:0:13162:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787790814.264651:0:13162:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787790814.264655:0:13162:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787790814.264659:0:13162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787790814.264664:0:13162:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787790814.264668:0:13162:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff931a493c0000) has no exports 00000020:00080000:3.0:1787790814.264689:0:13162:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff931a493c0000) has no exports 00010000:00010000:1.0:1787790814.266031:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787790814.266043:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a40030400/0x70647b5fa9774281 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa9774288 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790814.266054:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030400 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:1.0:1787790814.266058:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a40030400/0x70647b5fa9774281 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa9774288 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790814.266068:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a40030400/0x70647b5fa9774281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x70647b5fa9774288 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790814.266075:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a40030400/0x70647b5fa9774281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x70647b5fa9774288 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790814.266080:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787790814.266083:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787790814.266087:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787790814.266137:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a40030400/0x70647b5fa9774281 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa9774288 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790814.266143:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790814.266170:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a40030400/0x70647b5fa9774281 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa9774288 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790814.266177:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a40030400/0x70647b5fa9774281 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa9774288 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790814.266193:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790814.266196:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa97744b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa97744bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790814.266219:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654ee00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:1.0:1787790814.266222:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa97744b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa97744bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790814.266228:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa97744b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x70647b5fa97744bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790814.266235:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa97744b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x70647b5fa97744bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790814.266240:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787790814.266242:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787790814.266244:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787790814.266257:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa97744b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa97744bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790814.266262:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790814.266279:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa97744b8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa97744bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790814.266286:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa97744b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x70647b5fa97744bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790814.266296:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790814.266297:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790814.266299:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790814.266320:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253353984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790814.266403:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790814.266455:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790814.266468:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253354112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790814.266492:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790814.266529:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253353984 00000100:00100000:1.0:1787790814.266536:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253353984 00000100:00100000:1.0:1787790814.266566:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253354112 00000100:00100000:1.0:1787790814.266569:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253354112 00000100:00100000:1.0:1787790814.266585:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787790814.266592:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf12580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3318:x1874634253353984:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787790814.266598:0:5832:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787790814 with bad export cookie 8098733680714268508 00000100:00100000:1.0:1787790814.266640:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf12580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3318:x1874634253353984:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (237us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787790814.266647:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787790814.266663:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787790814.266667:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf10780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3318:x1874634253354112:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787790814.266671:0:5832:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787790814 with bad export cookie 8098733680714268508 00000100:00100000:1.0:1787790814.266695:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf10780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3318:x1874634253354112:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (203us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787790814.266701:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787790814.266760:0:3318:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.125@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787790814.266764:0:3318:0:(import.c:65:import_set_state_nolock()) ffff931a4646d000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787790814.266768:0:3318:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1787790814.266852:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787790814.267685:0:13162:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9319446599c0 - data ffff931a7fecf510/ffff931a7d76f000 00000020:01000000:3.0:1787790814.268002:0:13162:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff931a478203c0 - data ffff931a74f6e438/ffff93194549f400 00000100:00100000:0.0:1787790814.268675:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a48e25450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3321:x1874634253353856:12345-0@lo:103:ldlm_bl.0 Request processed in 6801us (7079us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787790814.268687:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1787790814.270910:0:3321:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.125@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787790814.277705:0:3318:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.125@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787790814.277711:0:3318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787790814.277911:0:3318:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff931a7be19e00 x1874634253353856/t0(0) o103->MGC192.168.201.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787790830 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790814.277927:0:3318:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff931a7bf11680 x1874634253353984/t0(0) o103->MGC192.168.201.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787790830 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790814.277956:0:3318:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff931a7bf121c0 x1874634253354112/t0(0) o103->MGC192.168.201.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787790830 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787790814.277964:0:3318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787790814.277967:0:3318:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787790814.277968:0:3318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787790814.278041:0:3321:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff931a4646d000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1787790814.278065:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be19e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3321:1874634253353856:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787790814.279765:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787790814.279772:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787790814.279776:0:8:0:(import.c:65:import_set_state_nolock()) ffff93194645c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787790814.279783:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 344 00000100:00080000:0.0:1787790814.279788:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787790814.279794:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93194645c800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1787790814.279825:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931a7be19680 x1874634253354240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787790814.279903:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be19680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1874634253354240:0@lo:38:kworker.0 00000400:00000100:3.0:1787790814.279956:0:3317:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874634253354240 offset 0 length 520: 4 00000100:00080000:1.0:1787790814.280132:0:3318:0:(import.c:65:import_set_state_nolock()) ffff931a4646d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787790814.280139:0:3318:0:(import.c:510:import_select_connection()) MGC192.168.201.125@tcp: connect to NID 0@lo last attempt 130 00000100:00080000:1.0:1787790814.280145:0:3318:0:(import.c:624:import_select_connection()) MGC192.168.201.125@tcp: import ffff931a4646d000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1787790814.280229:0:3318:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931a7be1b480 x1874634253354368/t0(0) o250->MGC192.168.201.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787790814.280265:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253353984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787790814.280297:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3317:1874634253354368:0@lo:250:ptlrpcd_00_00.0 00000100:00100000:0.0:1787790814.280302:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3318:1874634253354112:0@lo:103:ldlm_bl.0 00000400:00000100:3.0:1787790814.280325:0:3317:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874634253354368 offset 0 length 520: 4 00100000:10000000:0.0:1787790814.296546:0:13162:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787790814.353489:0:13162:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa9774090 00000020:00000080:3.0:1787790814.353504:0:13162:0:(genops.c:885:class_export_put()) final put ffff931a7d85d000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787790814.353607:0:13162:0:(tgt_mount.c:187:server_put_mount()) put mount ffff931a493ae800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787790814.353629:0:13162:0:(obd_mount.c:710:lustre_put_lsi()) put ffff931a493ae800 2 00000020:01000004:3.0:1787790814.353634:0:13162:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff931a493ae800 from lustre-OST0000 00000020:00000080:3.0:1787790814.353679:0:13162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787790814.353692:0:13162:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787790814.353695:0:13162:0:(genops.c:885:class_export_put()) final put ffff9319447e0000/lustre-OST0000_UUID 00000020:00000080:3.0:1787790814.353699:0:13162:0:(genops.c:844:class_export_destroy()) destroying export ffff9319447e0000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787790814.353706:0:13162:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787790814.353802:0:13162:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787790814.353807:0:13162:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787790814.353811:0:13162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787790814.353816:0:13162:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787790814.353823:0:13162:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff931a81162800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787790814.353839:0:13162:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff931a44ec0000) has exports, disconnecting them 00000020:00080000:3.0:1787790814.353844:0:13162:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff931a81162800), last request at 1787790613 00000020:00000080:3.0:1787790814.353848:0:13162:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa97740ba 00000020:00080000:3.0:1787790814.353859:0:13162:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff931a81162800): rc 0 00000020:00000080:3.0:1787790814.353868:0:13162:0:(genops.c:885:class_export_put()) final put ffff931a81162800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787790814.356578:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff931a7d85d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00010000:01000000:0.0:1787790814.360249:0:13162:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787790814.360258:0:13162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787790814.360262:0:13162:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787790814.360281:0:13162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787790814.360545:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff931a81162800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787790814.361165:0:13162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787790814.361176:0:13162:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1787790814.361182:0:13162:0:(obd_mount.c:710:lustre_put_lsi()) put ffff931a493ae800 1 00000020:00000080:0.0:1787790814.361189:0:13162:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa977404a 00000020:00000080:0.0:1787790814.361198:0:13162:0:(genops.c:885:class_export_put()) final put ffff931a81161000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787790814.361631:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff931a7c0a9800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787790814.361640:0:8:0:(genops.c:885:class_export_put()) final put ffff931a7c0a8000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787790814.361643:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff931a7c0a8000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787790814.361650:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787790814.361975:0:13162:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787790814.361982:0:13162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787790814.361989:0:13162:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787790814.361994:0:13162:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff931a493c4d28) has no exports 00000020:00000080:3.0:1787790814.362162:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff931a81161000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787790814.378858:0:13162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787790814.378872:0:13162:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787790814.378877:0:13162:0:(genops.c:885:class_export_put()) final put ffff931a493a9000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787790814.378881:0:13162:0:(genops.c:844:class_export_destroy()) destroying export ffff931a493a9000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787790814.378890:0:13162:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787790814.379015:0:13162:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff931a493ad800 00000020:02000400:2.0:1787790814.379058:0:13162:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787790814.981162:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790816.007442:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790817.025191:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787790817.334488:0:13314:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787790817.349089:0:13314:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787790817.349163:0:13314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a52848400/0x70647b5fa9774257 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977425e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790817.349190:0:13314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a52848400/0x70647b5fa9774257 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa977425e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790817.349197:0:13314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a52848400/0x70647b5fa9774257 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa977425e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790817.349204:0:13314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff931a52848400/0x70647b5fa9774257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa977425e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790817.349241:0:13314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787790817.349247:0:13314:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787790817.349270:0:13314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787790817.349281:0:13314:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff931a7be19680 x1874634253354240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787790829 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790817.349300:0:13314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787790817.349306:0:13314:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787790817.349324:0:13314:0:(import.c:65:import_set_state_nolock()) ffff93194645c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787790817.349328:0:13314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787790817.349332:0:13314:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff931a7be19680 x1874634253354240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787790829 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790817.349339:0:13314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787790817.349342:0:13314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:3.0:1787790817.349407:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be19680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1874634253354240:0@lo:38:kworker.0 00010000:00010000:0.0:1787790817.350668:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790817.350678:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a52848400/0x70647b5fa9774257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa977425e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790817.350687:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a52848400 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:0.0:1787790817.350691:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a52848400/0x70647b5fa9774257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa977425e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790817.350701:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a52848400/0x70647b5fa9774257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x70647b5fa977425e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790817.350709:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a52848400/0x70647b5fa9774257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x70647b5fa977425e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790817.350755:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787790817.350757:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787790817.350761:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787790817.350886:0:5834:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff931a4646d000 00010000:00010000:0.0:1787790817.350891:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a52848400/0x70647b5fa9774257 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x70647b5fa977425e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790817.350899:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a52848400/0x70647b5fa9774257 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x70647b5fa977425e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790817.350911:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790817.350914:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790817.350915:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790817.351371:0:13314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9774265 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977426c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790817.351382:0:13314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9774265 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa977426c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790817.351389:0:13314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9774265 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa977426c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790817.351396:0:13314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9774265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa977426c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790817.351419:0:13314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787790817.351425:0:13314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40030e00/0x70647b5fa97744aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97744b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790817.351431:0:13314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40030e00/0x70647b5fa97744aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97744b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790817.351437:0:13314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a40030e00/0x70647b5fa97744aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa97744b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790817.351443:0:13314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff931a40030e00/0x70647b5fa97744aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x70647b5fa97744b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790817.351477:0:13314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787790817.351482:0:13314:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787790817.351504:0:13314:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787790817.351508:0:13314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787790817.351513:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787790817.351518:0:13314:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787790817.351522:0:13314:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff931a44ec19b8) has no exports 00000020:00080000:2.0:1787790817.351556:0:13314:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff931a44ec19b8) has no exports 00010000:00010000:1.0:1787790817.353983:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787790817.353995:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9774265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa977426c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790817.354006:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704600 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:1.0:1787790817.354010:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9774265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa977426c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790817.354020:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9774265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x70647b5fa977426c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790817.354027:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9774265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x70647b5fa977426c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790817.354053:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787790817.354056:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787790817.354059:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1787790817.354075:0:5834:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff931a4646d000 00010000:00010000:1.0:1787790817.354079:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9774265 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x70647b5fa977426c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790817.354085:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9774265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x70647b5fa977426c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790817.354095:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790817.354099:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a40030e00/0x70647b5fa97744aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa97744b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790817.354105:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030e00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:1.0:1787790817.354107:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a40030e00/0x70647b5fa97744aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x70647b5fa97744b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790817.354114:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a40030e00/0x70647b5fa97744aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x70647b5fa97744b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790817.354120:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a40030e00/0x70647b5fa97744aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x70647b5fa97744b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790817.354125:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787790817.354127:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787790817.354129:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787790817.354134:0:5834:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff931a4646d000 00010000:00010000:1.0:1787790817.354137:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a40030e00/0x70647b5fa97744aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x70647b5fa97744b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790817.354150:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a40030e00/0x70647b5fa97744aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x70647b5fa97744b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790817.354575:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790817.354578:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790817.354580:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790817.354660:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787790817.355092:0:13314:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff931944659600 - data ffff931a7fecf6c0/ffff931a7d76fc00 00000020:01000000:2.0:1787790817.355313:0:13314:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff931a456ad360 - data ffff931944a9d438/ffff931a7db4c400 00100000:10000000:2.0:1787790817.366596:0:13314:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787790817.388515:0:13314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa977415b 00000020:00000080:3.0:1787790817.388525:0:13314:0:(genops.c:885:class_export_put()) final put ffff931a42e73800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787790817.388546:0:13314:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9319447e6800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787790817.388550:0:13314:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9319447e6800 2 00000020:01000004:3.0:1787790817.388553:0:13314:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9319447e6800 from lustre-OST0001 00000020:00000080:3.0:1787790817.388578:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787790817.388589:0:13314:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787790817.388593:0:13314:0:(genops.c:885:class_export_put()) final put ffff931a42e70800/lustre-OST0001_UUID 00000020:00000080:3.0:1787790817.388597:0:13314:0:(genops.c:844:class_export_destroy()) destroying export ffff931a42e70800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787790817.388605:0:13314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787790817.388701:0:13314:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e4f5edb7-fc08-421f-83d8-e03ffbb6fa21->MGS 00000020:00000080:1.0:1787790817.388884:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff931a42e73800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:3.0:1787790817.389021:0:13314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a41478a00/0x70647b5fa977406d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x70647b5fa9774074 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790817.389033:0:13314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a41478a00/0x70647b5fa977406d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x70647b5fa9774074 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790817.389039:0:13314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787790817.389042:0:13314:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787790817.389045:0:13314:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787790817.389060:0:13314:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff931a4646d000 00010000:00010000:3.0:1787790817.389063:0:13314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a41478a00/0x70647b5fa977406d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x70647b5fa9774074 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790817.389079:0:13314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97742ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x70647b5fa97742b2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790817.389086:0:13314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97742ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x70647b5fa97742b2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790817.389091:0:13314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787790817.389094:0:13314:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787790817.389095:0:13314:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787790817.389105:0:13314:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff931a4646d000 00010000:00010000:3.0:1787790817.389108:0:13314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a40030000/0x70647b5fa97742ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x70647b5fa97742b2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787790817.389125:0:13314:0:(import.c:65:import_set_state_nolock()) ffff931a4646d000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787790817.389129:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787790817.389131:0:13314:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787790817.389132:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787790817.389135:0:13314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787790817.389148:0:13314:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff931a7be1b480 x1874634253354368/t0(0) o250->MGC192.168.201.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787790824 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787790817.389394:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787790817.389397:0:13314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:1.0:1787790817.389452:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e4f5edb7-fc08-421f-83d8-e03ffbb6fa21:3317:1874634253354368:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:3.0:1787790817.389513:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787790817.389520:0:13314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa9773f4e 00000020:00000080:3.0:1787790817.389525:0:13314:0:(genops.c:885:class_export_put()) final put ffff931a79fc3800/e4f5edb7-fc08-421f-83d8-e03ffbb6fa21 00000020:01000000:3.0:1787790817.389539:0:13314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.125@tcp (flags='') 00000020:00000080:3.0:1787790817.389544:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787790817.389549:0:13314:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.125@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787790817.389553:0:13314:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff931a44ec4d28) has no exports 00000020:00000080:1.0:1787790817.389597:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff931a79fc3800/e4f5edb7-fc08-421f-83d8-e03ffbb6fa21 for MGC192.168.201.125@tcp 10000000:01000000:0.0:1787790817.389638:0:5843:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787790817.389712:0:13314:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.125@tcp: client import never connected 00000100:00080000:3.0:1787790817.389715:0:13314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787790817.389717:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787790817.389719:0:13314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787790817.389720:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787790817.389798:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787790817.389803:0:13314:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.125@tcp (uuid e4f5edb7-fc08-421f-83d8-e03ffbb6fa21) 00000020:01000000:3.0:1787790817.389807:0:13314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787790817.389810:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787790817.389813:0:13314:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787790817.389818:0:13314:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff93194645e800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787790817.389822:0:13314:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff931a44ec3370) has exports, disconnecting them 00000020:00080000:3.0:1787790817.389826:0:13314:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff93194645e800), last request at 1787790629 00000020:00000080:3.0:1787790817.389830:0:13314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa9774185 00000020:00080000:3.0:1787790817.389840:0:13314:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93194645e800): rc 0 00000020:00000080:3.0:1787790817.389844:0:13314:0:(genops.c:885:class_export_put()) final put ffff93194645e800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787790817.390745:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff931a4646d000 for MGC192.168.201.125@tcp 00000020:00000080:1.0:1787790817.390755:0:8:0:(genops.c:885:class_export_put()) final put ffff931a4646c000/e4f5edb7-fc08-421f-83d8-e03ffbb6fa21 00000020:00000080:1.0:1787790817.390758:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff931a4646c000/e4f5edb7-fc08-421f-83d8-e03ffbb6fa21 for MGC192.168.201.125@tcp 00000020:01000000:1.0:1787790817.390765:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.125@tcp (e4f5edb7-fc08-421f-83d8-e03ffbb6fa21) 00000020:00000080:1.0:1787790817.391025:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93194645e800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787790817.394829:0:13314:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787790817.394838:0:13314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787790817.394842:0:13314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787790817.394849:0:13314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787790817.394999:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93194645c800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1787790817.395017:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787790817.395311:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1787790817.395467:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff931a488b4e00:5829] 0 exiting: rc = 1 00000100:00100000:0.0:1787790817.410689:0:5830:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff931a47805200:5830] 1 exiting: rc = 0 00000100:00100000:1.0:1787790817.410930:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.411247:0:5833:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff931a49495c00:5833] 2 exiting: rc = 0 00000100:00100000:0.0:1787790817.411342:0:11653:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff931a47cb2600:11653] 4 exiting: rc = 0 00000100:00100000:0.0:1787790817.411408:0:5831:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff931a49495400:5831] 0 exiting: rc = 1 00000100:00100000:3.0:1787790817.411527:0:5832:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff931a49495e00:5832] 1 exiting: rc = 0 00000100:00100000:3.0:1787790817.411940:0:8498:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff931a80f3de00:8498] 3 exiting: rc = 0 00000100:00100000:1.0:1787790817.412044:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412051:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412058:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412064:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412069:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412075:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412081:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412100:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412105:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412111:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412116:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412121:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412127:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412133:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412139:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412145:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412150:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412230:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412237:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412243:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412248:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412253:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412259:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412264:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412270:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412274:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412279:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412284:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412289:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412293:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412298:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412303:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412307:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412312:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412316:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412321:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412325:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412330:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412334:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412338:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412343:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412347:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412359:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412365:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412370:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412375:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412380:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412385:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412389:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412394:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412399:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412404:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412408:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412412:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412417:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412422:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412426:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412431:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412436:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412440:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412445:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412449:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412454:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.412458:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787790817.413397:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787790817.413407:0:13314:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787790817.413413:0:13314:0:(genops.c:885:class_export_put()) final put ffff931a42e75800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787790817.413417:0:13314:0:(genops.c:844:class_export_destroy()) destroying export ffff931a42e75800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787790817.413421:0:13314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1787790817.413464:0:13314:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9319447e6800 1 00000020:00000080:1.0:1787790817.413470:0:13314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x70647b5fa977412a 00000020:00000080:1.0:1787790817.413476:0:13314:0:(genops.c:885:class_export_put()) final put ffff931a7d859000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787790817.413524:0:13314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787790817.413530:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787790817.413535:0:13314:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787790817.413538:0:13314:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff931a42f2cd28) has no exports 00000020:00000080:3.0:1787790817.419299:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff931a7d859000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787790817.428195:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787790817.428209:0:13314:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787790817.428226:0:13314:0:(genops.c:885:class_export_put()) final put ffff931a465e5800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787790817.428230:0:13314:0:(genops.c:844:class_export_destroy()) destroying export ffff931a465e5800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787790817.428237:0:13314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787790817.428433:0:13314:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff931a465e6000 00000020:01000000:1.0:1787790817.428453:0:13314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787790817.428458:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787790817.428463:0:13314:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787790817.428466:0:13314:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff931a7dc9b370) has no exports 00000020:00000080:1.0:1787790817.428498:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787790817.428504:0:13314:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787790817.428507:0:13314:0:(genops.c:885:class_export_put()) final put ffff931a81167800/OSS_uuid 00000020:00000080:1.0:1787790817.428509:0:13314:0:(genops.c:844:class_export_destroy()) destroying export ffff931a81167800/OSS_uuid for OSS 00000020:01000000:1.0:1787790817.428512:0:13314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1787790817.428543:0:5842:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787790817.429003:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff931a7dc8a000:6683] 0 exiting: rc = 1 00000100:00100000:0.0:1787790817.429058:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff931a4791ee00:6684] 1 exiting: rc = 0 00000100:00100000:3.0:1787790817.429240:0:8297:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff931a7d79a200:8297] 3 exiting: rc = 0 00000100:00100000:3.0:1787790817.429312:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff931a4791ec00:6685] 2 exiting: rc = 0 00000100:00100000:1.0:1787790817.429433:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429441:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429447:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429452:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429456:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429462:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429466:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429471:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429475:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429480:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429485:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429490:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429494:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429500:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429504:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429509:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429513:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429518:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429531:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429535:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429540:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429544:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429548:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429553:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429558:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429563:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429567:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429574:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429579:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429584:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429589:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429596:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429600:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429605:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429610:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429615:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429620:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429626:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429630:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429635:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429640:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429645:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429650:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429656:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429661:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429666:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429671:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429676:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429682:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429687:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429692:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429697:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429702:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429716:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429935:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429944:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429950:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429958:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429964:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429970:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429975:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429981:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429986:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.429991:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790817.431100:0:8510:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff931a7b84c000:8510] 2 exiting: rc = 0 00000100:00100000:3.0:1787790817.431284:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff931a8101cc00:6688] 1 exiting: rc = 0 00000100:00100000:3.0:1787790817.431922:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff931a4791f600:6686] 0 exiting: rc = 1 00000100:00100000:1.0:1787790817.432091:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432099:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432105:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432111:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432116:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432123:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432128:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432133:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432138:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432143:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432148:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432152:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432227:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432235:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432240:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432245:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432250:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432255:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432260:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432266:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432271:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432293:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432299:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432303:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432320:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432325:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432330:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432335:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432340:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432345:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432350:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432355:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432360:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432365:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432369:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432374:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432379:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432384:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432389:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432393:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432398:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432402:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432407:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432411:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432415:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432420:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432424:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432429:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432434:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432438:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432442:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432447:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432452:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432457:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432461:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432465:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432470:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432475:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432479:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432493:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432498:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432502:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432507:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.432512:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790817.433970:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff931a8102aa00:6691] 2 exiting: rc = 0 00000100:00100000:2.0:1787790817.434288:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff931a8102b800:6690] 1 exiting: rc = 0 00000100:00100000:3.0:1787790817.434312:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff931a8101d600:6689] 0 exiting: rc = 1 00000100:00100000:1.0:1787790817.434367:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434375:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434380:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434387:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434394:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434400:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434407:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434413:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434420:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434426:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434432:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434439:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434443:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434448:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434453:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434459:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434464:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434470:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434476:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434482:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434487:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434493:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434498:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434502:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434507:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434513:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434518:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434542:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434549:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434555:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434571:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434577:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434583:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434589:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434595:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434600:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434605:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434611:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434616:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434621:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434627:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434633:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434638:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434644:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434649:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434656:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434662:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434668:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434673:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434679:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434684:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434706:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434713:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434719:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434875:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434882:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434889:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434895:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434901:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434906:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434912:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434918:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434924:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.434930:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.449632:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff931a8102a200:6692] 0 exiting: rc = 1 00000100:00100000:0.0:1787790817.450578:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff931a8102ae00:6693] 1 exiting: rc = 0 00000100:00100000:3.0:1787790817.451071:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451079:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451085:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451090:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451095:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451100:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451105:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451110:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451116:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451121:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451126:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451132:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451137:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451141:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451147:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451151:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451168:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451174:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451180:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451185:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451190:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451195:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451200:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451206:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451219:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451225:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451231:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451236:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451242:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451260:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451266:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451271:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451277:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451282:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451288:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451294:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451300:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451305:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451311:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451317:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451322:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451328:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451333:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451338:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451344:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451349:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451354:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451359:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451367:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451371:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451376:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451383:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451388:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451392:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451397:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451403:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451408:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451413:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451418:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451422:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451427:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451431:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451436:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790817.451441:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.461454:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff931a8102b000:6694] 0 exiting: rc = 1 00000100:00100000:3.0:1787790817.468667:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff931a8102a000:6695] 1 exiting: rc = 0 00000100:00100000:1.0:1787790817.469627:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469637:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469642:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469650:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469655:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469661:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469668:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469675:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469699:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469707:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469713:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469720:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469752:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469758:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469764:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469780:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469787:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469795:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469802:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469808:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469832:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469838:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469843:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469851:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469857:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469862:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469867:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469873:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469878:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469885:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469891:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469896:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469917:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469924:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469930:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469949:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469955:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469961:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469967:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469972:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469978:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469984:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469990:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.469996:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.470017:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.470025:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.470031:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.470037:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.470043:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.470049:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.470055:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.470063:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.470069:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.470074:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.470080:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.470086:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.470106:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.470112:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.470118:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.470124:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.470130:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.470135:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.470141:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790817.470146:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787790817.496564:0:13314:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787790832.988281:0:13932:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787790839.813597:0:14394:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787790839.813601:0:14394:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787790839.813710:0:14394:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff931a4b638800 00000020:01000004:2.0:1787790839.814245:0:14394:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787790839.814253:0:14394:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787790839.814267:0:14394:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff931a42f899b8) 00000020:00000080:2.0:1787790839.814280:0:14394:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787790839.845589:0:14394:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787790839.852308:0:14394:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1787790839.852674:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 417: rc = 0 00100000:10000000:1.0:1787790839.853567:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 417: rc = 0 00100000:10000000:1.0:1787790839.853678:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 417: rc = 0 00100000:10000000:1.0:1787790839.853816:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 417: rc = 0 00100000:10000000:1.0:1787790839.853979:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 417: rc = 0 00100000:10000000:1.0:1787790839.854481:0:14394:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787790839.854555:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 417: rc = 0 00100000:10000000:1.0:1787790839.860658:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 419: rc = 0 00100000:10000000:1.0:1787790839.861848:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 493: rc = 0 00100000:10000000:1.0:1787790839.861954:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 493: rc = 0 00100000:10000000:1.0:1787790839.862345:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 501: rc = 0 00100000:10000000:1.0:1787790839.862679:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 501: rc = 0 00100000:10000000:1.0:1787790839.863597:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 501: rc = 0 00100000:10000000:1.0:1787790839.863963:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 501: rc = 0 00100000:10000000:1.0:1787790839.864879:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 501: rc = 0 00100000:10000000:1.0:1787790839.865512:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 501: rc = 0 00100000:10000000:1.0:1787790839.866178:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 501: rc = 0 00100000:10000000:1.0:1787790839.866553:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 501: rc = 0 00100000:10000000:1.0:1787790839.866886:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 501: rc = 0 00100000:10000000:1.0:1787790839.867505:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 501: rc = 0 00100000:10000000:1.0:1787790839.867783:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 501: rc = 0 00100000:10000000:1.0:1787790839.868323:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 501: rc = 0 00100000:10000000:1.0:1787790839.868979:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 779: rc = 0 00100000:10000000:1.0:1787790839.869332:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 779: rc = 0 00100000:10000000:1.0:1787790839.869587:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 779: rc = 0 00100000:10000000:1.0:1787790839.870299:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 779: rc = 0 00100000:10000000:1.0:1787790839.870610:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 779: rc = 0 00100000:10000000:1.0:1787790839.871968:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 779: rc = 0 00100000:10000000:2.0:1787790839.872481:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 779: rc = 0 00100000:10000000:2.0:1787790839.873035:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 779: rc = 0 00100000:10000000:2.0:1787790839.873280:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 779: rc = 0 00100000:10000000:2.0:1787790839.873633:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 779: rc = 0 00100000:10000000:2.0:1787790839.876692:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 779: rc = 0 00100000:10000000:2.0:1787790839.877673:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 779: rc = 0 00100000:10000000:2.0:1787790839.878654:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 779: rc = 0 00100000:10000000:2.0:1787790839.880698:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 779: rc = 0 00100000:10000000:2.0:1787790839.882370:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 779: rc = 0 00100000:10000000:2.0:1787790839.882634:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 779: rc = 0 00100000:10000000:2.0:1787790839.883100:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 779: rc = 0 00100000:10000000:2.0:1787790839.883908:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 779: rc = 0 00100000:10000000:2.0:1787790839.884158:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 779: rc = 0 00100000:10000000:2.0:1787790839.884415:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 779: rc = 0 00100000:10000000:2.0:1787790839.884673:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 779: rc = 0 00100000:10000000:2.0:1787790839.884962:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 779: rc = 0 00100000:10000000:2.0:1787790839.885208:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 779: rc = 0 00100000:10000000:2.0:1787790839.885451:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 779: rc = 0 00100000:10000000:2.0:1787790839.885689:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 779: rc = 0 00100000:10000000:2.0:1787790839.889570:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 779: rc = 0 00100000:10000000:2.0:1787790839.891952:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 779: rc = 0 00100000:10000000:2.0:1787790839.892247:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 779: rc = 0 00100000:10000000:2.0:1787790839.893172:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 779: rc = 0 00100000:10000000:2.0:1787790839.894057:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 779: rc = 0 00100000:10000000:2.0:1787790839.895428:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 779: rc = 0 00100000:10000000:2.0:1787790839.896405:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 779: rc = 0 00100000:10000000:2.0:1787790839.897606:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 517: rc = 0 00100000:10000000:2.0:1787790839.898265:0:14394:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787790839.899797:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 494: rc = 0 00100000:10000000:2.0:1787790839.900007:0:14394:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787790839.900075:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 494: rc = 0 00100000:10000000:2.0:1787790839.900253:0:14394:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787790839.900305:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 494: rc = 0 00100000:10000000:2.0:1787790839.900621:0:14394:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787790839.900675:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 498: rc = 0 00100000:10000000:2.0:1787790839.900880:0:14394:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1787790839.900943:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 498: rc = 0 00100000:10000000:2.0:1787790839.901116:0:14394:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787790839.901180:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 498: rc = 0 00000020:00000080:2.0:1787790839.901427:0:14394:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787790839.901435:0:14394:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787790839.901444:0:14394:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70647b5fa977524f 00000020:01000004:2.0:1787790839.901452:0:14394:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787790839.901456:0:14394:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787790839.901461:0:14394:0:(tgt_mount.c:101:server_register_mount()) register mount ffff931a4b638800 from MGS 00000020:01000004:2.0:1787790839.901465:0:14394:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787790839.901475:0:14394:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff931a42f8b370) 00000020:00000080:2.0:1787790839.901484:0:14394:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787790839.901533:0:14394:0:(tgt_mount.c:153:server_get_mount()) get mount ffff931a4b638800 from MGS, refs=2 00080000:01000000:2.0:1787790839.901537:0:14394:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787790839.901542:0:14394:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70647b5fa977525d 00000100:00100000:2.0:1787790839.901631:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787790839.901795:0:14394:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787790839.901801:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787790839.904075:0:14394:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787790839.904086:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787790839.905184:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787790839.905441:0:14394:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787790839.905453:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787790839.906236:0:14394:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787790839.906244:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787790839.906639:0:14394:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787790839.906645:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787790839.907497:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790839.907501:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790839.907502:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790839.907701:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790839.907704:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790839.907706:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790839.908412:0:14394:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787790839.918965:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787790839.928241:0:14394:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787790839.928257:0:14394:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787790839.928260:0:14394:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787790839.934159:0:14404:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787790839.934341:0:14394:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787790839.934468:0:14394:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787790839.934970:0:14394:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787790839.935261:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787790839.935561:0:14394:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787790839.935568:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787790839.937953:0:14394:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787790839.937968:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787790839.938374:0:14394:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787790839.938381:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787790839.939684:0:14394:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787790839.939701:0:14394:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.125@tcp' 00000020:01000004:0.0:1787790839.939702:0:14394:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787790839.939751:0:14394:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.125@tcp (typ=mgc) 00000020:00000080:0.0:1787790839.939763:0:14394:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.125@tcp (ffff931a44ec3370) 00000020:00000080:0.0:1787790839.939776:0:14394:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787790839.939860:0:14394:0:(ldlm_lib.c:102:import_set_conn()) imp ffff931a7d8e0800@MGC192.168.201.125@tcp: add connection 192.168.201.125@tcp at head 00000100:00080000:3.0:1787790839.939885:0:14408:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:0.0:1787790839.940021:0:14394:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.125@tcp-0 is initialized 00000040:01000000:0.0:1787790839.940028:0:14394:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787790839.941270:0:14409:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787790839.941341:0:14394:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.125@tcp (uuid 8529acdd-b606-48f0-be71-c40064ed5481) 00000020:00000080:0.0:1787790839.941361:0:14394:0:(genops.c:1385:class_connect()) connect: client 8529acdd-b606-48f0-be71-c40064ed5481, cookie 0x70647b5fa977526b 00000100:00080000:0.0:1787790839.941372:0:14394:0:(import.c:510:import_select_connection()) MGC192.168.201.125@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787790839.941378:0:14394:0:(import.c:624:import_select_connection()) MGC192.168.201.125@tcp: import ffff931a7d8e0800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1787790839.941412:0:14394:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931a7be19a40 x1874634253354496/t0(0) o250->MGC192.168.201.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787790839.941448:0:14394:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8529acdd-b606-48f0-be71-c40064ed5481->MGS 00000020:01000004:0.0:1787790839.941468:0:14394:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787790839.941497:0:14394:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787790839.941510:0:14394:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff931a44ec4d28) 00000020:00000080:0.0:1787790839.941523:0:14394:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787790839.941782:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8529acdd-b606-48f0-be71-c40064ed5481:3317:1874634253354496:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787790839.941865:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790839.942039:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253354496 00000100:00100000:2.0:1787790839.942047:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253354496 00000100:00100000:2.0:1787790839.942078:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787790839.942085:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3317:x1874634253354496:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787790839.942108:0:14405:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8529acdd-b606-48f0-be71-c40064ed5481@0@lo t0 exp 0000000000000000 cur 374 last 0 00000020:00000080:2.0:1787790839.942129:0:14405:0:(genops.c:1385:class_connect()) connect: client 8529acdd-b606-48f0-be71-c40064ed5481, cookie 0x70647b5fa9775279 00000100:00080000:2.0:1787790839.942251:0:14405:0:(import.c:65:import_set_state_nolock()) ffff931a493af800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787790839.942350:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+5:3317:x1874634253354496:12345-0@lo:250:mount.lustre.0 Request processed in 262us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790839.942358:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787790839.943907:0:3317:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.125@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787790839.943919:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.125@tcp: connect to target with instance 0 00000100:00080000:1.0:1787790839.943927:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.125@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787790839.943933:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787790839.943936:0:3317:0:(import.c:65:import_set_state_nolock()) ffff931a7d8e0800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787790839.943938:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787790839.943946:0:3317:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787790839.943952:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8529acdd-b606-48f0-be71-c40064ed5481:3317:1874634253354496:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787790839.953007:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787790839.953291:0:14394:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787790839.953297:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787790839.954114:0:14394:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787790839.954127:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787790839.956448:0:14394:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787790839.956457:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787790839.958521:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787790839.958692:0:14394:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787790839.958697:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787790839.959474:0:14394:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787790839.959481:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787790840.000956:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787790840.001198:0:14394:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787790840.001205:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787790840.001941:0:14394:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787790840.001949:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787790840.002531:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787790840.002655:0:14394:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787790840.002658:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787790840.003029:0:14394:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787790840.003034:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787790840.003860:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787790840.003994:0:14394:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787790840.003999:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787790840.004313:0:14394:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787790840.004318:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787790840.005223:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787790840.005367:0:14394:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787790840.005372:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787790840.007543:0:14394:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787790840.007554:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787790840.027188:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787790840.027406:0:14394:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787790840.027412:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787790840.028873:0:14394:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787790840.028883:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787790840.033527:0:14394:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787790840.033541:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787790840.034406:0:14394:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787790840.034430:0:14394:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787790840.034436:0:14394:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.125@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787790840.034553:0:14394:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787790840.034586:0:14394:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.125@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787790840.034589:0:14394:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787790840.034592:0:14394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787790840.034593:0:14394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790840.034594:0:14394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790840.034595:0:14394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790840.034596:0:14394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790840.034597:0:14394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787790840.034598:0:14394:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787790840.034599:0:14394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790840.034600:0:14394:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787790840.034602:0:14394:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787790840.034603:0:14394:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787790840.034604:0:14394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787790840.034605:0:14394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790840.034605:0:14394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790840.034606:0:14394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790840.034606:0:14394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790840.034607:0:14394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787790840.034608:0:14394:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787790840.034608:0:14394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790840.034609:0:14394:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787790840.034631:0:14394:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787790840.034647:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253354624:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787790840.034703:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790840.034858:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253354624 00000100:00100000:2.0:1787790840.034865:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253354624 00000100:00100000:2.0:1787790840.034906:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787790840.034916:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+5:14394:x1874634253354624:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787790840.034957:0:14407:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787790840.034960:0:14407:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787790840.034963:0:14407:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00100000:1.0:1787790840.035046:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d741480 going to sleep for 11 seconds 10000000:01000000:1.0:1787790840.038127:0:14427:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787790840.045258:0:14407:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1787790840.050987:0:14428:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787790840.050997:0:14428:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787790840.050999:0:14428:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787790840.051032:0:14428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1787790840.051407:0:14407:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787790840.051417:0:14407:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787790840.065608:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+5:14394:x1874634253354624:12345-0@lo:253:mount.lustre.0 Request processed in 30684us (30894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790840.065624:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787790840.065908:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253354624:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787790840.065925:0:14394:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787790840.065928:0:14394:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787790840.065930:0:14394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787790840.065931:0:14394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790840.065932:0:14394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790840.065933:0:14394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790840.065947:0:14394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790840.065948:0:14394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787790840.065950:0:14394:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787790840.065952:0:14394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790840.065953:0:14394:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787790840.065977:0:14394:0:(tgt_mount.c:101:server_register_mount()) register mount ffff931a4b638800 from lustre-MDT0000 10000000:01000000:1.0:1787790840.066003:0:14394:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787790840.066006:0:14394:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787790840.066011:0:14394:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff931a44ec3370 10000000:01000000:1.0:1787790840.066018:0:14394:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787790840.066026:0:14394:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff931a44ec3370 from 1 10000000:01000000:1.0:1787790840.066029:0:14394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787790840.066065:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45705800/0x70647b5fa9775280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.066076:0:14394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a45705800/0x70647b5fa9775280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.066086:0:14394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a45705800/0x70647b5fa9775280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790840.066105:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253354752:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787790840.066143:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790840.066223:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d7413c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790840.069292:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253354752 00000100:00100000:2.0:1787790840.069306:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253354752 00000100:00100000:2.0:1787790840.069366:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787790840.069567:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+5:14394:x1874634253354752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787790840.069583:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790840.069674:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a67980600/0x70647b5fa9775287 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9775280 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.069701:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a67980600/0x70647b5fa9775287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9775280 expref: 6 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.069830:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a67980600/0x70647b5fa9775287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9775280 expref: 6 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.069841:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67980600, rc 0) 00000100:00100000:0.0:1787790840.069923:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+6:14394:x1874634253354752:12345-0@lo:101:mount.lustre.0 Request processed in 548us (3779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790840.069929:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787790840.070051:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253354752:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787790840.070070:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a45705800/0x70647b5fa9775280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775287 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.070079:0:14394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a45705800/0x70647b5fa9775280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9775287 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790840.070149:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253354880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787790840.070188:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790840.070223:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d7413c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790840.070352:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253354880 00000100:00100000:2.0:1787790840.070357:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253354880 00000100:00100000:2.0:1787790840.070494:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787790840.070502:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+6:14394:x1874634253354880:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787790840.070760:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+6:14394:x1874634253354880:12345-0@lo:501:mount.lustre.0 Request processed in 258us (571us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787790840.070776:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787790840.070846:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253354880:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787790840.070870:0:14394:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787790840.070893:0:14394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45705800/0x70647b5fa9775280 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775287 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.070901:0:14394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a45705800/0x70647b5fa9775280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775287 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790840.070910:0:14394:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff931a4b638800 10000000:01000000:1.0:1787790840.070914:0:14394:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787790840.070918:0:14394:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff931a4b638800 10000000:01000000:1.0:1787790840.070921:0:14394:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787790840.070924:0:14394:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff931a4b638800 from 1 10000000:01000000:1.0:1787790840.070928:0:14394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787790840.070948:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45704200/0x70647b5fa977528e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.070956:0:14394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a45704200/0x70647b5fa977528e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.070965:0:14394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a45704200/0x70647b5fa977528e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790840.070978:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253355008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787790840.071004:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790840.074334:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253355008 00000100:00100000:3.0:1787790840.074347:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253355008 00000100:00100000:1.0:1787790840.074368:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d7413c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790840.074389:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787790840.074397:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+6:14394:x1874634253355008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787790840.074409:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790840.074425:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a82153400/0x70647b5fa9775295 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa977528e expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790840.074446:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a82153400/0x70647b5fa9775295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa977528e expref: 7 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790840.074454:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a82153400/0x70647b5fa9775295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa977528e expref: 7 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790840.074461:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153400, rc 0) 00000100:00100000:3.0:1787790840.074506:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+7:14394:x1874634253355008:12345-0@lo:101:mount.lustre.0 Request processed in 109us (3501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790840.074511:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787790840.074529:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253355008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787790840.074559:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a45704200/0x70647b5fa977528e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775295 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.074569:0:14394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a45704200/0x70647b5fa977528e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9775295 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790840.074584:0:14394:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787790840.074602:0:14394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45704200/0x70647b5fa977528e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775295 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.074608:0:14394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a45704200/0x70647b5fa977528e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775295 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790840.074616:0:14394:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787790840.074620:0:14394:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787790840.074625:0:14394:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff931a4b638800 10000000:01000000:1.0:1787790840.074628:0:14394:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787790840.074631:0:14394:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787790840.074634:0:14394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787790840.074655:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45705400/0x70647b5fa977529c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.074662:0:14394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a45705400/0x70647b5fa977529c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.074668:0:14394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a45705400/0x70647b5fa977529c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790840.074685:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253355136:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787790840.074875:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790840.074893:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d7413c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790840.074957:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253355136 00000100:00100000:0.0:1787790840.074961:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253355136 00000100:00100000:0.0:1787790840.074989:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787790840.074998:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+7:14394:x1874634253355136:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787790840.075006:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790840.075016:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a67981e00/0x70647b5fa97752a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa977529c expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.075046:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a67981e00/0x70647b5fa97752a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa977529c expref: 8 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.075055:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a67981e00/0x70647b5fa97752a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa977529c expref: 8 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.075061:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981e00, rc 0) 00000100:00100000:0.0:1787790840.075099:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+8:14394:x1874634253355136:12345-0@lo:101:mount.lustre.0 Request processed in 103us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790840.075105:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787790840.075317:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253355136:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787790840.075329:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a45705400/0x70647b5fa977529c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97752a3 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.075337:0:14394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a45705400/0x70647b5fa977529c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97752a3 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790840.075397:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253355264:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787790840.075423:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790840.075442:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d7413c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790840.075496:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253355264 00000100:00100000:3.0:1787790840.075500:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253355264 00000100:00100000:3.0:1787790840.075537:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787790840.075541:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+8:14394:x1874634253355264:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787790840.075896:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+9:14394:x1874634253355264:12345-0@lo:501:mount.lustre.0 Request processed in 353us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790840.075904:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787790840.075935:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253355264:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787790840.075966:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253355392:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787790840.076006:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790840.076100:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253355392 00000100:00100000:0.0:1787790840.076104:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253355392 00000100:00100000:0.0:1787790840.076178:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787790840.076185:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+9:14394:x1874634253355392:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787790840.076483:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+9:14394:x1874634253355392:12345-0@lo:503:mount.lustre.0 Request processed in 298us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790840.076490:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787790840.076537:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d7413c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790840.076550:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253355392:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787790840.076945:0:14429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be183c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8529acdd-b606-48f0-be71-c40064ed5481:14429:1874634253355520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790840.076981:0:14429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790840.077004:0:14429:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a428a7900 going to sleep for 11 seconds 00000100:00100000:3.0:1787790840.077021:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253355520 00000100:00100000:3.0:1787790840.077027:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253355520 00000100:00100000:3.0:1787790840.077061:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787790840.077070:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+9:14429:x1874634253355520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790840.077284:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+9:14429:x1874634253355520:12345-0@lo:502:llog_process_th.0 Request processed in 217us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790840.077289:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787790840.077322:0:14429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be183c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8529acdd-b606-48f0-be71-c40064ed5481:14429:1874634253355520:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787790840.077349:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790840.077360:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790840.077362:0:14429:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787790840.077369:0:14429:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787790840.077371:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787790840.077446:0:14429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff931a44ec19b8) 00000020:00000080:0.0:1787790840.077462:0:14429:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787790840.077468:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787790840.077531:0:14429:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787790840.077538:0:14429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70647b5fa97752b1 00000020:00000080:0.0:1787790840.077845:0:14429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787790840.077850:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790840.077854:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790840.077856:0:14429:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787790840.077859:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790840.077863:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790840.077864:0:14429:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787790840.077867:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787790840.077875:0:14429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff931a44ec0000) 00000020:00000080:0.0:1787790840.077884:0:14429:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787790840.077895:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787790840.077897:0:14429:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787790840.077900:0:14429:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787790840.077905:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787790840.077949:0:14429:0:(tgt_mount.c:153:server_get_mount()) get mount ffff931a4b638800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787790840.077971:0:14429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff931a432f8000) 00000020:00000080:0.0:1787790840.077985:0:14429:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787790840.078157:0:14429:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787790840.078163:0:14429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x70647b5fa97752c6 00000020:00000080:0.0:1787790840.078263:0:14429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787790840.078269:0:14429:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787790840.078273:0:14429:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x70647b5fa97752cd 00080000:01000000:0.0:1787790840.078278:0:14429:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787790840.078283:0:14429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70647b5fa97752d4 00010000:00010000:1.0:1787790840.130987:0:14429:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1787790840.131478:0:14429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1787790840.131671:0:14429:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787790840.132260:0:14429:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff931a7dc98000) 00000020:00000080:1.0:1787790840.132279:0:14429:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787790840.132340:0:14429:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787790840.132346:0:14429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70647b5fa97752e2 00000020:00000080:3.0:1787790840.137685:0:14429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787790840.144019:0:14429:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x70647b5fa97752e9 00000020:00000080:3.0:1787790840.147900:0:14429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787790840.147914:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790840.147924:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790840.147926:0:14429:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787790840.147932:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787790840.147934:0:14429:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1787790840.147936:0:14429:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787790840.147937:0:14429:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787790840.147939:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787790840.147942:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790840.147943:0:14429:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787790840.147946:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790840.147951:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790840.147952:0:14429:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787790840.147957:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787790840.148002:0:14429:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787790840.148033:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790840.148037:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790840.148038:0:14429:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787790840.148041:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787790840.148044:0:14429:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787790840.148047:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790840.148048:0:14429:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787790840.148050:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787790840.148056:0:14429:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.125@tcp to nid 0x20000c0a8c97d (192.168.201.125@tcp) 00000020:01000000:3.0:1787790840.148102:0:14429:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787790840.148105:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787790840.148120:0:14429:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff931a42f28000) 00000020:00000080:3.0:1787790840.148139:0:14429:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787790840.148144:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787790840.148196:0:14429:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787790840.148201:0:14429:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787790840.148208:0:14429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70647b5fa97752f7 00010000:00080000:3.0:1787790840.148252:0:14429:0:(ldlm_lib.c:102:import_set_conn()) imp ffff931a48887800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.125@tcp at head 00010000:00010000:3.0:1787790840.148469:0:14429:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1787790840.149089:0:14429:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787790840.149134:0:14429:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787790840.150052:0:14429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787790840.150110:0:14429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787790840.150177:0:14429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787790840.151422:0:14433:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787790840.151429:0:14433:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787790840.152224:0:14429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787790840.152236:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787790840.152265:0:14429:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787790840.152284:0:14429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x70647b5fa97752fe 00000100:00080000:3.0:1787790840.152294:0:14429:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787790840.152301:0:14429:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff931a48887800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:3.0:1787790840.152335:0:14429:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93194581f840 x1874634253355648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787790840.152471:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1874634253355648:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787790840.152525:0:3317:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634253355648 offset 0 length 520: 4 00000100:00080000:3.0:1787790840.152583:0:14429:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787790840.152635:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790840.152639:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790840.152641:0:14429:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787790840.152644:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787790840.152646:0:14429:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1787790840.152648:0:14429:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787790840.152650:0:14429:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787790840.152651:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787790840.152653:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790840.152654:0:14429:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787790840.152657:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787790840.152660:0:14429:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787790840.152663:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790840.152665:0:14429:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787790840.152667:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787790840.152671:0:14429:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.125@tcp to nid 0x20000c0a8c97d (192.168.201.125@tcp) 00000020:01000000:3.0:1787790840.152691:0:14429:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787790840.152694:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787790840.152705:0:14429:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff931a42f299b8) 00000020:00000080:3.0:1787790840.152716:0:14429:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787790840.152720:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787790840.152812:0:14429:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787790840.152829:0:14429:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787790840.152837:0:14429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70647b5fa977530c 00010000:00080000:3.0:1787790840.152869:0:14429:0:(ldlm_lib.c:102:import_set_conn()) imp ffff931a716af800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.125@tcp at head 00010000:00010000:3.0:1787790840.153066:0:14429:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1787790840.153245:0:14429:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787790840.153267:0:14429:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787790840.154086:0:14429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787790840.154151:0:14429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787790840.154240:0:14429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1787790840.154787:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8529acdd-b606-48f0-be71-c40064ed5481:3320:1874634253355776:0@lo:400:kworker.0 00000100:00100000:2.0:1787790840.154862:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790840.155018:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253355776 00000100:00100000:1.0:1787790840.155026:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253355776 00000100:00100000:1.0:1787790840.155071:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787790840.155080:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+9:3320:x1874634253355776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790840.155344:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+9:3320:x1874634253355776:12345-0@lo:400:kworker.0 Request processed in 265us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790840.155353:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787790840.155487:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8529acdd-b606-48f0-be71-c40064ed5481:3320:1874634253355776:0@lo:400:kworker.0 00000040:00080000:0.0:1787790840.155678:0:14435:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787790840.155683:0:14435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787790840.156650:0:14429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787790840.156663:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787790840.156693:0:14429:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787790840.156711:0:14429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x70647b5fa9775313 00000100:00080000:2.0:1787790840.156958:0:14429:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787790840.156967:0:14429:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff931a716af800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:2.0:1787790840.157001:0:14429:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931a7befed00 x1874634253355904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787790840.157026:0:14429:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787790840.157110:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790840.157114:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790840.157116:0:14429:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787790840.157119:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790840.157123:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790840.157124:0:14429:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787790840.157127:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787790840.157129:0:14429:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787790840.157131:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790840.157134:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790840.157135:0:14429:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787790840.157138:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790840.157140:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790840.157142:0:14429:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787790840.157145:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787790840.157184:0:14429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8529acdd-b606-48f0-be71-c40064ed5481:14429:1874634253356032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790840.157254:0:14429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790840.157289:0:14429:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a456cb000 going to sleep for 11 seconds 00000100:00100000:1.0:1787790840.157351:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1874634253355904:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787790840.157391:0:3317:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634253355904 offset 0 length 520: 4 00000100:00100000:3.0:1787790840.157505:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253356032 00000100:00100000:3.0:1787790840.157512:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253356032 00000100:00100000:3.0:1787790840.157558:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787790840.157568:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+9:14429:x1874634253356032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790840.158156:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+9:14429:x1874634253356032:12345-0@lo:502:llog_process_th.0 Request processed in 588us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790840.158164:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787790840.158266:0:14429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8529acdd-b606-48f0-be71-c40064ed5481:14429:1874634253356032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787790840.158295:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790840.158300:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790840.158302:0:14429:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787790840.158306:0:14429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787790840.158536:0:14394:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1787790840.158553:0:14394:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787790840.158578:0:14394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45705400/0x70647b5fa977529c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97752a3 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.158589:0:14394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a45705400/0x70647b5fa977529c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97752a3 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790840.158597:0:14394:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff931a4b638800 from 1 10000000:01000000:1.0:1787790840.158600:0:14394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787790840.158631:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45705e00/0x70647b5fa977531a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.158639:0:14394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a45705e00/0x70647b5fa977531a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.158647:0:14394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a45705e00/0x70647b5fa977531a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790840.158669:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253356160:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787790840.158701:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790840.158842:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d741540 going to sleep for 11 seconds 00000100:00100000:3.0:1787790840.158969:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253356160 00000100:00100000:3.0:1787790840.158974:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253356160 00000100:00100000:3.0:1787790840.159002:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787790840.159009:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+9:14394:x1874634253356160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787790840.159019:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790840.159033:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a82152c00/0x70647b5fa9775321 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa977531a expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790840.159053:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a82152c00/0x70647b5fa9775321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa977531a expref: 10 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790840.159062:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a82152c00/0x70647b5fa9775321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa977531a expref: 10 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790840.159070:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82152c00, rc 0) 00000100:00100000:3.0:1787790840.159190:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+10:14394:x1874634253356160:12345-0@lo:101:mount.lustre.0 Request processed in 180us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790840.159196:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787790840.159328:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253356160:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787790840.159343:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a45705e00/0x70647b5fa977531a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775321 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.159352:0:14394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a45705e00/0x70647b5fa977531a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9775321 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790840.160186:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253356288:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787790840.160237:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790840.160305:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a456cb000 going to sleep for 11 seconds 00000100:00100000:0.0:1787790840.160375:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253356288 00000100:00100000:0.0:1787790840.160447:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253356288 00000100:00100000:0.0:1787790840.160532:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787790840.160541:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+10:14394:x1874634253356288:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787790840.160557:0:14405:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787790840.160562:0:14405:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787790840.160639:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+10:14394:x1874634253356288:12345-0@lo:256:mount.lustre.0 Request processed in 100us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790840.160647:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787790840.160706:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253356288:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787790840.161334:0:14394:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787790840.161355:0:14394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45705e00/0x70647b5fa977531a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775321 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.161365:0:14394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a45705e00/0x70647b5fa977531a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775321 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790840.161374:0:14394:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff931a4b638800 from 1 10000000:01000000:2.0:1787790840.161443:0:14394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787790840.161473:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa9775328 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.161482:0:14394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa9775328 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.161491:0:14394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa9775328 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790840.161506:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253356416:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787790840.161543:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790840.162001:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a456cb000 going to sleep for 11 seconds 00000100:00100000:1.0:1787790840.162101:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253356416 00000100:00100000:1.0:1787790840.162107:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253356416 00000100:00100000:1.0:1787790840.162143:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787790840.162152:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+10:14394:x1874634253356416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787790840.162162:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790840.162177:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a45705a00/0x70647b5fa977532f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9775328 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.162198:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a45705a00/0x70647b5fa977532f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9775328 expref: 11 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.162208:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a45705a00/0x70647b5fa977532f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9775328 expref: 11 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.162216:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45705a00, rc 0) 00000100:00100000:1.0:1787790840.162264:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+11:14394:x1874634253356416:12345-0@lo:101:mount.lustre.0 Request processed in 114us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790840.162271:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787790840.162345:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253356416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787790840.162358:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa9775328 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977532f expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.162368:0:14394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa9775328 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa977532f expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790840.162487:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253356544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787790840.162516:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790840.162544:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a456cb000 going to sleep for 11 seconds 00000100:00100000:1.0:1787790840.162588:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253356544 00000100:00100000:1.0:1787790840.162592:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253356544 00000100:00100000:1.0:1787790840.162609:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787790840.162614:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+11:14394:x1874634253356544:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787790840.163033:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+11:14394:x1874634253356544:12345-0@lo:501:mount.lustre.0 Request processed in 417us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790840.163046:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787790840.163328:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253356544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787790840.163363:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253356672:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787790840.163474:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790840.163497:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a456cb000 going to sleep for 11 seconds 00000100:00100000:1.0:1787790840.163544:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253356672 00000100:00100000:1.0:1787790840.163548:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253356672 00000100:00100000:1.0:1787790840.163581:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787790840.163588:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+11:14394:x1874634253356672:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787790840.163907:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+11:14394:x1874634253356672:12345-0@lo:503:mount.lustre.0 Request processed in 319us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790840.163914:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787790840.164041:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253356672:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787790840.164362:0:14437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf10f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8529acdd-b606-48f0-be71-c40064ed5481:14437:1874634253356800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790840.164479:0:14437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790840.164544:0:14437:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d741d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790840.164577:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253356800 00000100:00100000:0.0:1787790840.164582:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253356800 00000100:00100000:0.0:1787790840.164641:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787790840.164649:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+11:14437:x1874634253356800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790840.164903:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+11:14437:x1874634253356800:12345-0@lo:502:llog_process_th.0 Request processed in 254us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790840.164916:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787790840.165025:0:14437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf10f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8529acdd-b606-48f0-be71-c40064ed5481:14437:1874634253356800:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787790840.165052:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790840.165065:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790840.165068:0:14437:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787790840.165076:0:14437:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff931a4b638800 00000020:00000080:3.0:1787790840.165079:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787790840.165086:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790840.165088:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790840.165089:0:14437:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787790840.165092:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790840.165094:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790840.165095:0:14437:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787790840.165099:0:14437:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff931a4b638800 00000020:00000080:3.0:1787790840.165101:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787790840.165155:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790840.165159:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790840.165161:0:14437:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787790840.165163:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790840.165166:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790840.165167:0:14437:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787790840.165171:0:14437:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff931a4b638800 00000020:00000080:3.0:1787790840.165173:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787790840.165211:0:14437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8529acdd-b606-48f0-be71-c40064ed5481:14437:1874634253356928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790840.165247:0:14437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790840.169242:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253356928 00000100:00100000:1.0:1787790840.169254:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253356928 00000100:00100000:1.0:1787790840.169303:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787790840.169313:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+11:14437:x1874634253356928:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790840.171509:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+11:14437:x1874634253356928:12345-0@lo:502:llog_process_th.0 Request processed in 2189us (6252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790840.171522:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787790840.172872:0:14437:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a478503c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790840.172908:0:14437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8529acdd-b606-48f0-be71-c40064ed5481:14437:1874634253356928:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787790840.172949:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790840.172957:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790840.172960:0:14437:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787790840.172965:0:14437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787790840.173149:0:14394:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787790840.173170:0:14394:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787790840.173186:0:14394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa9775328 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977532f expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.173197:0:14394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa9775328 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977532f expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790840.173244:0:14394:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787790840.173247:0:14394:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff931a4b638800 10000000:01000000:2.0:1787790840.173249:0:14394:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff931a4b638800 10000000:01000000:2.0:1787790840.173253:0:14394:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787790840.173258:0:14394:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff931a4b638800 from 1 10000000:01000000:2.0:1787790840.173260:0:14394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787790840.173290:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a4654fa00/0x70647b5fa9775336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.173299:0:14394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a4654fa00/0x70647b5fa9775336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.173308:0:14394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a4654fa00/0x70647b5fa9775336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790840.173327:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253357056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787790840.173451:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790840.173484:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a456cb480 going to sleep for 11 seconds 00000100:00100000:0.0:1787790840.173535:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253357056 00000100:00100000:0.0:1787790840.173541:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253357056 00000100:00100000:0.0:1787790840.173579:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787790840.173588:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+11:14394:x1874634253357056:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787790840.173603:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790840.173615:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a67980400/0x70647b5fa977533d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9775336 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.173638:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a67980400/0x70647b5fa977533d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9775336 expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.173648:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a67980400/0x70647b5fa977533d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9775336 expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.173655:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67980400, rc 0) 00000100:00100000:0.0:1787790840.173696:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+12:14394:x1874634253357056:12345-0@lo:101:mount.lustre.0 Request processed in 110us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790840.173705:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787790840.174572:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253357056:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787790840.174590:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a4654fa00/0x70647b5fa9775336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977533d expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.174612:0:14394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a4654fa00/0x70647b5fa9775336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa977533d expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790840.174671:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253357184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787790840.174708:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790840.174841:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a456cb480 going to sleep for 11 seconds 00000100:00100000:0.0:1787790840.174895:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253357184 00000100:00100000:0.0:1787790840.174900:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253357184 00000100:00100000:0.0:1787790840.174930:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787790840.174947:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+12:14394:x1874634253357184:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787790840.175223:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+12:14394:x1874634253357184:12345-0@lo:501:mount.lustre.0 Request processed in 275us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790840.175230:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787790840.175916:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253357184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787790840.175961:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253357312:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787790840.176006:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790840.176040:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a456cb480 going to sleep for 11 seconds 00000100:00100000:0.0:1787790840.176464:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253357312 00000100:00100000:0.0:1787790840.176470:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253357312 00000100:00100000:0.0:1787790840.176504:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787790840.176511:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+12:14394:x1874634253357312:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787790840.176686:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+12:14394:x1874634253357312:12345-0@lo:503:mount.lustre.0 Request processed in 174us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790840.176694:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787790840.177877:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253357312:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787790840.178996:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be18780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8529acdd-b606-48f0-be71-c40064ed5481:14441:1874634253357440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790840.179067:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790840.180886:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a428a7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787790840.188037:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253357440 00000100:00100000:2.0:1787790840.188052:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253357440 00000100:00100000:2.0:1787790840.188129:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787790840.188140:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+12:14441:x1874634253357440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790840.188570:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+12:14441:x1874634253357440:12345-0@lo:502:llog_process_th.0 Request processed in 431us (9501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790840.188578:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787790840.191985:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be18780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8529acdd-b606-48f0-be71-c40064ed5481:14441:1874634253357440:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787790840.192086:0:14441:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787790840.192102:0:14441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff931a432f99b8) 00000020:00000080:0.0:1787790840.192122:0:14441:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1787790840.192213:0:14441:0:(tgt_mount.c:153:server_get_mount()) get mount ffff931a4b638800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787790840.192217:0:14441:0:(tgt_mount.c:187:server_put_mount()) put mount ffff931a4b638800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787790840.192220:0:14441:0:(obd_mount.c:710:lustre_put_lsi()) put ffff931a4b638800 4 00010000:00080000:0.0:1787790840.192246:0:14441:0:(ldlm_lib.c:102:import_set_conn()) imp ffff931a464ee800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.125@tcp at head 00010000:00010000:0.0:1787790840.196233:0:14441:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1787790840.196554:0:14441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787790840.196593:0:14441:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787790840.196608:0:14441:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x70647b5fa977534b 00000100:00080000:0.0:1787790840.196619:0:14441:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787790840.196632:0:14441:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff931a464ee800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1787790840.196682:0:14441:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931a7be18780 x1874634253357568/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787790840.196712:0:14441:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787790840.196915:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874634253357568:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787790840.196983:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790840.197766:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253357568 00000100:00100000:0.0:1787790840.197774:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253357568 00000100:00100000:0.0:1787790840.197807:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790840.197813:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1874634253357568:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787790840.197885:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1874634253357568:12345-0@lo:38:llog_process_th.0 Request processed in 69us (899us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787790840.197892:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787790840.198084:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787790840.198091:0:3317:0:(import.c:65:import_set_state_nolock()) ffff931a464ee800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787790840.198095:0:3317:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787790840.198100:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874634253357568:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787790840.199032:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf13480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8529acdd-b606-48f0-be71-c40064ed5481:14441:1874634253357696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790840.199100:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790840.199130:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253357696 00000100:00100000:1.0:1787790840.199136:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253357696 00000100:00100000:1.0:1787790840.199172:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787790840.199180:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+12:14441:x1874634253357696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790840.199474:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+12:14441:x1874634253357696:12345-0@lo:502:llog_process_th.0 Request processed in 295us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790840.199482:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787790840.199581:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a44b930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790840.199598:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf13480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8529acdd-b606-48f0-be71-c40064ed5481:14441:1874634253357696:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787790840.199621:0:14441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787790840.201203:0:14394:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787790840.201233:0:14394:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787790840.201254:0:14394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a4654fa00/0x70647b5fa9775336 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977533d expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.201266:0:14394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a4654fa00/0x70647b5fa9775336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977533d expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787790840.201314:0:14394:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787790840.201316:0:14394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787790840.201317:0:14394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787790840.201318:0:14394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787790840.201320:0:14394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787790840.201321:0:14394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787790840.201323:0:14394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787790840.201324:0:14394:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787790840.201326:0:14394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787790840.201327:0:14394:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787790840.201331:0:14394:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787790840.201333:0:14394:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787790840.201339:0:14394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787790840.201340:0:14394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787790840.201341:0:14394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787790840.201342:0:14394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787790840.201343:0:14394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787790840.201344:0:14394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787790840.201344:0:14394:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787790840.201345:0:14394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787790840.201346:0:14394:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787790840.201369:0:14394:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787790840.201398:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253357824:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787790840.201460:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790840.201492:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a428a7900 going to sleep for 11 seconds 00000100:00100000:2.0:1787790840.201637:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253357824 00000100:00100000:2.0:1787790840.201643:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253357824 00000100:00100000:2.0:1787790840.201680:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787790840.201688:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+12:14394:x1874634253357824:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787790840.201710:0:14407:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787790840.201753:0:14407:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787790840.239956:0:14407:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787790840.239975:0:14407:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787790840.240025:0:14427:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787790840.240030:0:14427:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787790840.240052:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff931a45705c00/0x70647b5fa9775352 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.240070:0:14427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a82152c00/0x70647b5fa9775321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa977531a expref: 12 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.240079:0:14427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff931a45705c00/0x70647b5fa9775352 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.240120:0:14427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a82152c00/0x70647b5fa9775321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa977531a expref: 12 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.240135:0:14427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff931a82152c00/0x70647b5fa9775321 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa977531a expref: 12 pid: 14407 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790840.240150:0:14427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf13480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14427:1874634253357952:0@lo:104: 00000100:00100000:1.0:1787790840.240226:0:14427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790840.240268:0:14427:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a455f9000 going to sleep for 11 seconds 00000100:00100000:0.0:1787790840.240696:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253357952 00000100:00100000:0.0:1787790840.240705:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253357952 00000100:00100000:0.0:1787790840.240790:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790840.240800:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf13840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8529acdd-b606-48f0-be71-c40064ed5481+3:14427:x1874634253357952:12345-0@lo:104: 00010000:00010000:0.0:1787790840.240813:0:14395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a45705e00/0x70647b5fa977531a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9775321 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.240875:0:14395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787790840.240882:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf13840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8529acdd-b606-48f0-be71-c40064ed5481+3:14427:x1874634253357952:12345-0@lo:104: Request processed in 83us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790840.240889:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787790840.240909:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790840.240915:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a45705e00/0x70647b5fa977531a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9775321 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.240922:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705e00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:0.0:1787790840.240926:0:14401:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a45705e00/0x70647b5fa977531a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa9775321 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.240941:0:14401:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a45705e00/0x70647b5fa977531a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa9775321 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790840.240949:0:14401:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a45705e00/0x70647b5fa977531a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa9775321 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790840.240954:0:14401:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787790840.240984:0:14401:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a45705e00/0x70647b5fa977531a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9775321 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.240990:0:14401:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790840.241011:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a45705e00/0x70647b5fa977531a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9775321 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.241019:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a45705e00/0x70647b5fa977531a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9775321 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.241037:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790840.241038:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790840.241040:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790840.241257:0:14427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf13480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14427:1874634253357952:0@lo:104: 00010000:00010000:1.0:1787790840.241279:0:14427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff931a45705c00/0x70647b5fa9775352 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790840.241523:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8529acdd-b606-48f0-be71-c40064ed5481:3321:1874634253358080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787790840.241563:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790840.244625:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253358080 00000100:00100000:0.0:1787790840.244640:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253358080 00010000:00010000:0.0:1787790840.244679:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a82152c00/0x70647b5fa9775321 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa977531a expref: 13 pid: 14407 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790840.244713:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790840.244747:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8529acdd-b606-48f0-be71-c40064ed5481+13:3321:x1874634253358080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790840.244762:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790840.244767:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a82152c00/0x70647b5fa9775321 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa977531a expref: 13 pid: 14407 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.244793:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a82152c00/0x70647b5fa9775321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa977531a expref: 13 pid: 14407 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.244810:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a82152c00/0x70647b5fa9775321 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa977531a expref: 13 pid: 14407 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.244837:0:14397:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff931a45705c00/0x70647b5fa9775352 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.244845:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a45705c00/0x70647b5fa9775352 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787790840.244861:0:14397:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004831467s 00010000:00010000:0.0:1787790840.244865:0:14397:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a45705c00/0x70647b5fa9775352 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.244872:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a45705c00/0x70647b5fa9775352 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.244878:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff931a45705c00/0x70647b5fa9775352 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.244886:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff931a45705c00/0x70647b5fa9775352 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.244892:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705c00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:0.0:1787790840.244896:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff931a45705c00/0x70647b5fa9775352 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.244903:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff931a45705c00/0x70647b5fa9775352 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.244926:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff931a45705c00/0x70647b5fa9775352 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.244936:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790840.245007:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8529acdd-b606-48f0-be71-c40064ed5481+12:3321:x1874634253358080:12345-0@lo:103:ldlm_bl.0 Request processed in 286us (3442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790840.245014:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787790840.245229:0:14427:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff931a45705c00/0x70647b5fa9775352 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.245238:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff931a45705c00/0x70647b5fa9775352 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.245244:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a45705c00/0x70647b5fa9775352 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790840.245795:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8529acdd-b606-48f0-be71-c40064ed5481:3321:1874634253358080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787790840.246828:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+11:14394:x1874634253357824:12345-0@lo:253:mount.lustre.0 Request processed in 45128us (45354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790840.246840:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787790840.247040:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:14394:1874634253357824:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787790840.247055:0:14394:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787790840.247058:0:14394:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787790840.247059:0:14394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787790840.247061:0:14394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787790840.247062:0:14394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787790840.247063:0:14394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787790840.247065:0:14394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787790840.247066:0:14394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787790840.247067:0:14394:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787790840.247069:0:14394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787790840.247070:0:14394:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787790840.247080:0:14394:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787790840.252701:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787790840.253004:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787790840.253270:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787790840.253520:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787790840.253914:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787790840.254053:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787790840.254636:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787790840.254942:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787790840.255160:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787790840.255344:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787790840.255619:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787790840.256022:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1787790840.282673:0:14394:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1787790840.283393:0:14394:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787790840.283553:0:14448:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787790840.283558:0:14448:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1787790840.283677:0:14449:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787790840.285495:0:14449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787790840.289371:0:14449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:01000000:1.0:1787790840.289713:0:14394:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000004:00080000:0.0:1787790840.289927:0:14449:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787790840.289932:0:14449:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1787790840.290026:0:14394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787790840.290488:0:14394:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787790840.290495:0:14394:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787790840.290633:0:14394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787790840.291700:0:14394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787790840.292321:0:14394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787790840.292355:0:14394:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1787790840.296249:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1787790840.301710:0:14394:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787790840.332580:0:14394:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787790840.332620:0:14394:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4954146f988 00100000:10000000:1.0:1787790840.332628:0:14394:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787790840.333584:0:14394:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787790840.333599:0:14394:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.125@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787790840.333613:0:14394:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787790840.333637:0:14394:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787790840.960841:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787790841.219426:0:14444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1787790841.344586:0:14409:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787790841.344594:0:14409:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff931a4b638800 from 6 10000000:01000000:2.0:1787790841.344600:0:14409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787790841.344645:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa9775359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790841.344674:0:14409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa9775359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790841.344686:0:14409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa9775359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790841.344713:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253358208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787790841.344830:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790841.344875:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a42f60d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790841.344946:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253358208 00000100:00100000:0.0:1787790841.344953:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253358208 00000100:00100000:0.0:1787790841.345029:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787790841.345038:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+11:14409:x1874634253358208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790841.345053:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790841.345117:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a45704c00/0x70647b5fa9775360 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9775359 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.345146:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a45704c00/0x70647b5fa9775360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9775359 expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.345166:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a45704c00/0x70647b5fa9775360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9775359 expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.345175:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a45704c00, rc 0) 00000100:00100000:1.0:1787790841.345222:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+12:14409:x1874634253358208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790841.345229:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787790841.345623:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253358208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790841.345636:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa9775359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775360 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790841.345645:0:14409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa9775359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9775360 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790841.345695:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253358336:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787790841.345755:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790841.345775:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253358336 00000100:00100000:2.0:1787790841.345776:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a42f60d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790841.345780:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253358336 00000100:00100000:0.0:1787790841.345820:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787790841.345828:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+12:14409:x1874634253358336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787790841.345847:0:14407:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787790841.345861:0:14407:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787790841.345864:0:14407:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787790841.345942:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+12:14409:x1874634253358336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790841.345949:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787790841.349121:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253358336:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787790841.349205:0:14409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787790841.349215:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa9775359 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775360 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.349226:0:14409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa9775359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775360 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.983914:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787790842.247084:0:14444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787790843.012191:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787790843.481749:0:14692:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787790844.031958:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790845.057869:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787790845.508859:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787790845.508865:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787790845.508868:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787790845.508871:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787790845.508874:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787790845.508887:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787790845.508891:0:8:0:(import.c:65:import_set_state_nolock()) ffff931a464ee800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787790845.508902:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff931a464ee800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:1.0:1787790845.508922:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931a7bf13480 x1874634253358592/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787790845.508986:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8529acdd-b606-48f0-be71-c40064ed5481:3318:1874634253358464:0@lo:400:kworker.0 00000100:00100000:1.0:1787790845.509053:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790845.509118:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253358464 00000100:00100000:1.0:1787790845.509125:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253358464 00000100:00100000:1.0:1787790845.509165:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787790845.509173:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+12:3318:x1874634253358464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790845.509216:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+12:3318:x1874634253358464:12345-0@lo:400:kworker.0 Request processed in 45us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790845.509223:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787790845.509267:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8529acdd-b606-48f0-be71-c40064ed5481:3318:1874634253358464:0@lo:400:kworker.0 00000100:00100000:3.0:1787790845.511330:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874634253358592:0@lo:38:kworker.0 00000100:00100000:3.0:1787790845.512378:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790845.513443:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253358592 00000100:00100000:1.0:1787790845.513453:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253358592 00000100:00100000:1.0:1787790845.513496:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787790845.513504:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3317:x1874634253358592:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787790845.513531:0:14413:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 380 last 0 00000020:00000080:1.0:1787790845.513565:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x70647b5fa9775367 00000004:00100000:1.0:1787790845.513581:0:14413:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787790845.513716:0:14413:0:(import.c:65:import_set_state_nolock()) ffff931a48880800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787790845.513811:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874634253358592:12345-0@lo:38:kworker.0 Request processed in 306us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790845.513828:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787790845.513878:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff931a7bf13480 x1874634253358592/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787790855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787790845.513895:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787790845.513904:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787790845.513908:0:3317:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787790845.513911:0:3317:0:(import.c:65:import_set_state_nolock()) ffff931a464ee800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787790845.513917:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874634253358592:0@lo:38:kworker.0 00000020:00000080:3.0:1787790845.943239:0:14842:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7bd0cca0 20000000:00000080:3.0:1787790845.943257:0:14842:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff931a48be0400 uarg=0000000000000000 20000000:01000000:3.0:1787790845.943288:0:14842:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787790845.943294:0:14842:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787790845.943299:0:14842:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787790845.944254:0:14843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1787790845.944437:0:14842:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787790845.952165:0:14842:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787790845.952199:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff931a82152200/0x70647b5fa977536e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.952219:0:14842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a45705a00/0x70647b5fa977532f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9775328 expref: 11 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.952228:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff931a82152200/0x70647b5fa977536e lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.952273:0:14842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a45705a00/0x70647b5fa977532f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa9775328 expref: 11 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.952299:0:14842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff931a45705a00/0x70647b5fa977532f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa9775328 expref: 11 pid: 14406 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790845.952314:0:14842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14842:1874634253358720:0@lo:104: 00000100:00100000:3.0:1787790845.952387:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790845.952458:0:14842:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a43a1c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790845.952598:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253358720 00000100:00100000:1.0:1787790845.952606:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253358720 00000100:00100000:1.0:1787790845.952667:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787790845.952677:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8529acdd-b606-48f0-be71-c40064ed5481+3:14842:x1874634253358720:12345-0@lo:104: 00010000:00010000:1.0:1787790845.952701:0:14395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa9775328 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa977532f expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.953021:0:14395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787790845.953028:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8529acdd-b606-48f0-be71-c40064ed5481+3:14842:x1874634253358720:12345-0@lo:104: Request processed in 353us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790845.953036:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787790845.953102:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790845.953108:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa9775328 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa977532f expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.953117:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654ee00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:3.0:1787790845.953122:0:14401:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa9775328 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa977532f expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.953142:0:14401:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa9775328 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa977532f expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790845.953150:0:14401:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa9775328 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa977532f expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790845.953156:0:14401:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787790845.953192:0:14401:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa9775328 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa977532f expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.953200:0:14401:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787790845.953217:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa9775328 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa977532f expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.953224:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a4654ee00/0x70647b5fa9775328 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa977532f expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.953244:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790845.953246:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790845.953248:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790845.953315:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8529acdd-b606-48f0-be71-c40064ed5481:3319:1874634253358848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790845.953350:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790845.953444:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253358848 00000100:00100000:3.0:1787790845.953449:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253358848 00010000:00010000:3.0:1787790845.953467:0:14399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a45705a00/0x70647b5fa977532f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9775328 expref: 12 pid: 14406 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790845.953495:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790845.953503:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf13c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8529acdd-b606-48f0-be71-c40064ed5481+12:3319:x1874634253358848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787790845.953512:0:14399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790845.953517:0:14399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a45705a00/0x70647b5fa977532f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9775328 expref: 12 pid: 14406 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.953533:0:14399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a45705a00/0x70647b5fa977532f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa9775328 expref: 12 pid: 14406 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.953550:0:14399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff931a82152200/0x70647b5fa977536e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.953558:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a82152200/0x70647b5fa977536e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.953573:0:14399:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a82152200/0x70647b5fa977536e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.953581:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a82152200/0x70647b5fa977536e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.953587:0:14399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff931a82152200/0x70647b5fa977536e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.953594:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff931a82152200/0x70647b5fa977536e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.953599:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152200 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790845.953603:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff931a82152200/0x70647b5fa977536e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.953611:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff931a82152200/0x70647b5fa977536e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.953619:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff931a82152200/0x70647b5fa977536e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.953640:0:14399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790845.953667:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf13c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8529acdd-b606-48f0-be71-c40064ed5481+12:3319:x1874634253358848:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790845.953674:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787790845.953998:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8529acdd-b606-48f0-be71-c40064ed5481:3319:1874634253358848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787790845.957448:0:14842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a45705a00/0x70647b5fa977532f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa9775328 expref: 11 pid: 14406 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790845.957475:0:14842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14842:1874634253358720:0@lo:104: 00010000:00010000:2.0:1787790845.957502:0:14842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff931a82152200/0x70647b5fa977536e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.957528:0:14842:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff931a82152200/0x70647b5fa977536e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.957535:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff931a82152200/0x70647b5fa977536e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.957541:0:14842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a82152200/0x70647b5fa977536e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.082883:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790847.106135:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787790847.107171:0:14409:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787790847.107179:0:14409:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff931a4b638800 from 10 10000000:01000000:1.0:1787790847.107192:0:14409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787790847.107258:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9775375 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790847.107273:0:14409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9775375 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790847.107286:0:14409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9775375 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790847.107319:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf10f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253358976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787790847.107412:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790847.107470:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b976e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790847.107854:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253358976 00000100:00100000:2.0:1787790847.107865:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253358976 00000100:00100000:2.0:1787790847.107933:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787790847.107944:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+11:14409:x1874634253358976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790847.107961:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790847.107979:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a4654fc00/0x70647b5fa977537c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9775375 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790847.108010:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a4654fc00/0x70647b5fa977537c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9775375 expref: 12 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790847.108023:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a4654fc00/0x70647b5fa977537c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9775375 expref: 12 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790847.108034:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654fc00, rc 0) 00000100:00100000:2.0:1787790847.108172:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+12:14409:x1874634253358976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790847.108180:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787790847.108601:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf10f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253358976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790847.108629:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9775375 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977537c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790847.108641:0:14409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9775375 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa977537c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790847.109305:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253359104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790847.109362:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790847.109409:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b9f6840 going to sleep for 11 seconds 00000100:00100000:0.0:1787790847.110034:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253359104 00000100:00100000:0.0:1787790847.110157:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253359104 00000100:00100000:0.0:1787790847.110221:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787790847.110603:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+12:14409:x1874634253359104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790847.112029:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+12:14409:x1874634253359104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1420us (2656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790847.112365:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253359104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790847.112437:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253359232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790847.112888:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787790847.113010:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790847.113139:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b9f6840 going to sleep for 11 seconds 00000100:00100000:0.0:1787790847.113325:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253359232 00000100:00100000:0.0:1787790847.113334:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253359232 00000100:00100000:0.0:1787790847.113389:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787790847.113399:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+12:14409:x1874634253359232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790847.114413:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+12:14409:x1874634253359232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1009us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790847.114425:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787790847.114906:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253359232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787790847.118602:0:14882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787790847.122751:0:14409:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787790847.122974:0:14409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787790847.122992:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9775375 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977537c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790847.123008:0:14409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9775375 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977537c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790848.128898:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790849.159015:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790850.176861:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790850.628738:0:3317:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787790840/real 1787790840] req@ffff931a7befed00 x1874634253355904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790850 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790850.628772:0:3317:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff931a7befed00 x1874634253355904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790850 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790850.628784:0:3317:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787790840/real 1787790840] req@ffff93194581f840 x1874634253355648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790850 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790850.628796:0:3317:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93194581f840 x1874634253355648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790850 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787790850.628813:0:3317:0:(import.c:65:import_set_state_nolock()) ffff931a716af800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787790850.632875:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787790850.632881:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787790850.632898:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787790850.632901:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787790850.632905:0:8:0:(import.c:65:import_set_state_nolock()) ffff931a716af800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787790850.632914:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 375 00000100:00080000:0.0:1787790850.632919:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787790850.632926:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff931a716af800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1787790850.632950:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931a7be18f00 x1874634253359488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787790850.633001:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253359616:0@lo:400:kworker.0 00000100:00100000:0.0:1787790850.633071:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790850.634630:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787790850.634655:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8529acdd-b606-48f0-be71-c40064ed5481:3321:1874634253359360:0@lo:400:kworker.0 00000100:00100000:0.0:1787790850.634713:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790850.634793:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253359616 00000100:00100000:0.0:1787790850.634801:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253359616 00000100:00100000:0.0:1787790850.634847:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790850.634856:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253359616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790850.634908:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253359616:12345-0@lo:400:kworker.0 Request processed in 53us (1837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790850.634916:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787790850.634956:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff931a7be1b480 x1874634253359616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790850.634970:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253359616:0@lo:400:kworker.0 00000100:00100000:1.0:1787790850.635620:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253359360 00000100:00100000:1.0:1787790850.635626:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253359360 00000100:00100000:1.0:1787790850.635667:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787790850.635675:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+12:3321:x1874634253359360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790850.635734:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+12:3321:x1874634253359360:12345-0@lo:400:kworker.0 Request processed in 47us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790850.635742:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787790850.635782:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8529acdd-b606-48f0-be71-c40064ed5481:3321:1874634253359360:0@lo:400:kworker.0 00000100:00080000:3.0:1787790850.636049:0:3317:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787790850.636056:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1874634253355904:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787790850.636066:0:3317:0:(import.c:65:import_set_state_nolock()) ffff931a48887800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787790850.636081:0:3317:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787790850.636084:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1874634253355648:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787790850.636116:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1874634253359488:0@lo:8:kworker.0 00000400:00000100:3.0:1787790850.636148:0:3317:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634253359488 offset 0 length 520: 4 00000100:00080000:0.0:1787790850.640491:0:13164:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787790850.640501:0:13164:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787790850.640512:0:13164:0:(import.c:65:import_set_state_nolock()) ffff931a48887800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787790850.640520:0:13164:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 375 00000100:00080000:0.0:1787790850.640527:0:13164:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787790850.640534:0:13164:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff931a48887800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1787790850.640569:0:13164:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931a7be1b480 x1874634253359744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787790850.643292:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1874634253359744:0@lo:8:kworker.0 00000400:00000100:1.0:1787790850.643373:0:3317:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634253359744 offset 0 length 520: 4 00010000:00010000:1.0:1787790851.200012:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787790851.462281:0:15092:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787790851.462285:0:15092:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787790851.462392:0:15092:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff931a5ffca000 00000020:01000004:2.0:1787790851.462409:0:15092:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787790851.462421:0:15092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787790851.462433:0:15092:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff931a42f88000) 00000020:00000080:2.0:1787790851.462449:0:15092:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787790851.490449:0:15092:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787790851.491075:0:15092:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787790851.492096:0:15092:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787790851.492410:0:15092:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787790851.492615:0:15092:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787790851.494935:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 413: rc = 0 00100000:10000000:3.0:1787790851.495036:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 413: rc = 0 00100000:10000000:3.0:1787790851.495132:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 413: rc = 0 00100000:10000000:3.0:1787790851.495618:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 735: rc = 0 00100000:10000000:3.0:1787790851.496062:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 735: rc = 0 00100000:10000000:3.0:1787790851.496475:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 735: rc = 0 00100000:10000000:3.0:1787790851.497013:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 735: rc = 0 00100000:10000000:3.0:1787790851.497343:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 735: rc = 0 00100000:10000000:3.0:1787790851.497594:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 735: rc = 0 00000020:00000080:3.0:1787790851.498490:0:15092:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787790851.498501:0:15092:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787790851.498513:0:15092:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x70647b5fa977538a 00000020:01000004:3.0:1787790851.498521:0:15092:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787790851.498541:0:15092:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.125@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787790851.498544:0:15092:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787790851.498550:0:15092:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787790851.498554:0:15092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787790851.498570:0:15092:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff931a42f2b370) 00000020:00000080:3.0:1787790851.498582:0:15092:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1787790851.500196:0:15092:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787790851.500351:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787790851.500356:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787790851.503276:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787790851.503288:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787790851.505276:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787790851.505287:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787790851.512472:0:15092:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787790851.512905:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787790851.512915:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787790851.513522:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787790851.513530:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787790851.534474:0:15092:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787790851.534931:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787790851.534939:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787790851.536206:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787790851.536218:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787790851.537243:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787790851.537252:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787790851.545557:0:15092:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787790851.545973:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787790851.545988:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787790851.547374:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787790851.547384:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787790851.619457:0:15092:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787790851.619833:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787790851.619840:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787790851.621084:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787790851.621094:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787790851.621626:0:15092:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787790851.621651:0:15092:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787790851.621657:0:15092:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.125@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787790851.634091:0:15092:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787790851.634131:0:15092:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.125@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787790851.634135:0:15092:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787790851.634137:0:15092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787790851.634138:0:15092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787790851.634139:0:15092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787790851.634141:0:15092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787790851.634142:0:15092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787790851.634143:0:15092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787790851.634145:0:15092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787790851.634146:0:15092:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787790851.634150:0:15092:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787790851.634152:0:15092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787790851.634154:0:15092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787790851.634155:0:15092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787790851.634156:0:15092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787790851.634157:0:15092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787790851.634158:0:15092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787790851.634159:0:15092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787790851.634160:0:15092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787790851.634166:0:15092:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787790851.634296:0:15092:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787790851.634318:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be19e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253359872:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787790851.634403:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790851.634521:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a478f1000 going to sleep for 11 seconds 00000100:00100000:2.0:1787790851.635969:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253359872 00000100:00100000:2.0:1787790851.635979:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253359872 00000100:00100000:2.0:1787790851.636077:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787790851.636086:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+12:15092:x1874634253359872:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787790851.636136:0:14406:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787790851.636140:0:14406:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787790851.636144:0:14406:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787790851.646598:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+12:15092:x1874634253359872:12345-0@lo:253:mount.lustre.0 Request processed in 10504us (12187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790851.646615:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787790851.646771:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be19e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253359872:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787790851.646787:0:15092:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787790851.646790:0:15092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787790851.646792:0:15092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787790851.646793:0:15092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787790851.646794:0:15092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787790851.646795:0:15092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787790851.646797:0:15092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787790851.646798:0:15092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787790851.646800:0:15092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787790851.646802:0:15092:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787790851.646821:0:15092:0:(tgt_mount.c:101:server_register_mount()) register mount ffff931a5ffca000 from lustre-OST0000 10000000:01000000:2.0:1787790851.646847:0:15092:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787790851.646850:0:15092:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787790851.646857:0:15092:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff931a44ec3370 local copy 00010000:00010000:2.0:1787790851.646866:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45705800/0x70647b5fa9775280 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775287 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790851.647081:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253360000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787790851.647119:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790851.647214:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67cd10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790851.647511:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253360000 00000100:00100000:1.0:1787790851.647525:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253360000 00000100:00100000:1.0:1787790851.647773:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787790851.647783:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+12:15092:x1874634253360000:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787790851.647954:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+12:15092:x1874634253360000:12345-0@lo:501:mount.lustre.0 Request processed in 173us (834us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787790851.647961:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787790851.648039:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253360000:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787790851.648055:0:15092:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787790851.648234:0:15092:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787790851.648241:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45705800/0x70647b5fa9775280 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775287 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790851.648251:0:15092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a45705800/0x70647b5fa9775280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775287 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790851.648276:0:15092:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff931a5ffca000 10000000:01000000:2.0:1787790851.648281:0:15092:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787790851.648286:0:15092:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff931a44ec3370 10000000:01000000:2.0:1787790851.648288:0:15092:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787790851.648291:0:15092:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff931a44ec3370 from 1 10000000:01000000:2.0:1787790851.648294:0:15092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787790851.648332:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a4654ec00/0x70647b5fa9775398 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790851.648341:0:15092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a4654ec00/0x70647b5fa9775398 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790851.648350:0:15092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a4654ec00/0x70647b5fa9775398 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790851.648369:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253360128:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787790851.648399:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790851.650512:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67cd10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790851.650700:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253360128 00000100:00100000:0.0:1787790851.650709:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253360128 00000100:00100000:0.0:1787790851.650771:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787790851.650780:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+12:15092:x1874634253360128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787790851.650793:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790851.650811:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a67980800/0x70647b5fa977539f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9775398 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790851.650837:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a67980800/0x70647b5fa977539f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9775398 expref: 13 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790851.650848:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a67980800/0x70647b5fa977539f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9775398 expref: 13 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790851.650857:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67980800, rc 0) 00000100:00100000:0.0:1787790851.650910:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+13:15092:x1874634253360128:12345-0@lo:101:mount.lustre.0 Request processed in 131us (2510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790851.650916:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787790851.651050:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253360128:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787790851.651066:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a4654ec00/0x70647b5fa9775398 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977539f expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790851.651076:0:15092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a4654ec00/0x70647b5fa9775398 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa977539f expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790851.651110:0:15092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787790851.651128:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a4654ec00/0x70647b5fa9775398 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977539f expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790851.651144:0:15092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a4654ec00/0x70647b5fa9775398 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977539f expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790851.651152:0:15092:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787790851.651157:0:15092:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787790851.651163:0:15092:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787790851.651165:0:15092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787790851.651291:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a4654e000/0x70647b5fa97753a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790851.651299:0:15092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a4654e000/0x70647b5fa97753a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790851.651307:0:15092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a4654e000/0x70647b5fa97753a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790851.651335:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253360256:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787790851.651369:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790851.651388:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67cd10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790851.651507:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253360256 00000100:00100000:0.0:1787790851.651512:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253360256 00000100:00100000:0.0:1787790851.651534:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787790851.651548:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+13:15092:x1874634253360256:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787790851.651556:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790851.651565:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a67981200/0x70647b5fa97753ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97753a6 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790851.651578:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a67981200/0x70647b5fa97753ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97753a6 expref: 14 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790851.651587:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a67981200/0x70647b5fa97753ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97753a6 expref: 14 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790851.651593:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981200, rc 0) 00000100:00100000:0.0:1787790851.651642:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+14:15092:x1874634253360256:12345-0@lo:101:mount.lustre.0 Request processed in 94us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790851.651647:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787790851.651758:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253360256:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787790851.651769:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a4654e000/0x70647b5fa97753a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97753ad expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790851.651777:0:15092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a4654e000/0x70647b5fa97753a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97753ad expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787790851.654672:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787790851.658874:0:15092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787790851.659170:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787790851.659218:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787790851.659254:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787790851.659303:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787790851.659337:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787790851.659367:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787790851.659427:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787790851.659436:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787790851.659524:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253360384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787790851.659594:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790851.659768:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253360384 00000100:00100000:0.0:1787790851.659775:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253360384 00000100:00100000:0.0:1787790851.659821:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787790851.659830:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+14:15092:x1874634253360384:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787790851.660533:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67cd1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787790851.660611:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+14:15092:x1874634253360384:12345-0@lo:501:mount.lustre.0 Request processed in 781us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790851.660630:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787790851.660714:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253360384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787790851.660778:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253360512:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787790851.660822:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790851.660890:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67cd1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787790851.661023:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253360512 00000100:00100000:3.0:1787790851.661028:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253360512 00000100:00100000:3.0:1787790851.661095:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787790851.661104:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+14:15092:x1874634253360512:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787790851.661631:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+14:15092:x1874634253360512:12345-0@lo:503:mount.lustre.0 Request processed in 527us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790851.661640:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787790851.661713:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253360512:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787790851.662389:0:15092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787790851.662468:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253360640:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787790851.662515:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790851.662896:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67cd1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787790851.662965:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253360640 00000100:00100000:0.0:1787790851.662970:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253360640 00000100:00100000:0.0:1787790851.663004:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787790851.663013:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+14:15092:x1874634253360640:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787790851.663291:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+14:15092:x1874634253360640:12345-0@lo:502:mount.lustre.0 Request processed in 278us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790851.663307:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787790851.663487:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253360640:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787790851.663776:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787790851.663827:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787790851.663874:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787790851.663915:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787790851.663950:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787790851.663979:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787790851.664024:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787790851.664060:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787790851.664090:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787790851.664134:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787790851.664166:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787790851.664288:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787790851.664397:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253360768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787790851.664453:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790851.664470:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67cd1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787790851.664563:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253360768 00000100:00100000:0.0:1787790851.664568:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253360768 00000100:00100000:0.0:1787790851.664595:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787790851.664603:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+14:15092:x1874634253360768:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787790851.664804:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+14:15092:x1874634253360768:12345-0@lo:502:mount.lustre.0 Request processed in 202us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790851.664812:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787790851.664996:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253360768:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787790851.665062:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787790851.665072:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1787790851.666077:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787790851.666085:0:15106:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787790851.666094:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790851.666096:0:15106:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787790851.666103:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787790851.666118:0:15106:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff931a42f8cd28) 00000020:00000080:2.0:1787790851.666151:0:15106:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787790851.666158:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787790851.666406:0:15106:0:(tgt_mount.c:153:server_get_mount()) get mount ffff931a5ffca000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787790851.666413:0:15106:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787790851.666421:0:15106:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x70647b5fa97753bb 00010000:00010000:2.0:1787790851.678315:0:15106:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787790851.682483:0:15106:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1787790851.689171:0:15106:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787790851.692271:0:15106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787790851.692293:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790851.692299:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790851.692301:0:15106:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787790851.692304:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787790851.692307:0:15106:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787790851.692309:0:15106:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787790851.692310:0:15106:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787790851.692312:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787790851.692314:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790851.692316:0:15106:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787790851.692319:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790851.693466:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790851.693470:0:15106:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787790851.693478:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787790851.693480:0:15106:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787790851.693483:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790851.693486:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790851.693487:0:15106:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787790851.693490:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790851.693492:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790851.693493:0:15106:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787790851.693496:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787790851.693560:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790851.693564:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790851.693565:0:15106:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787790851.693569:0:15106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1787790851.693835:0:15092:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787790851.693865:0:15092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787790851.693885:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a4654e000/0x70647b5fa97753a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97753ad expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790851.693897:0:15092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a4654e000/0x70647b5fa97753a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97753ad expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790851.693905:0:15092:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff931a5ffca000 from 1 10000000:01000000:0.0:1787790851.693907:0:15092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787790851.693946:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97753c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790851.693954:0:15092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97753c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790851.693966:0:15092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97753c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790851.693992:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253360896:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787790851.694070:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790851.694108:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a478f1000 going to sleep for 11 seconds 00000100:00100000:0.0:1787790851.694426:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253360896 00000100:00100000:0.0:1787790851.694434:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253360896 00000100:00100000:0.0:1787790851.694484:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787790851.694494:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+14:15092:x1874634253360896:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787790851.694507:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790851.694520:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a67981c00/0x70647b5fa97753c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97753c2 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790851.694543:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a67981c00/0x70647b5fa97753c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97753c2 expref: 15 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790851.694552:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a67981c00/0x70647b5fa97753c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97753c2 expref: 15 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790851.694560:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981c00, rc 0) 00000100:00100000:0.0:1787790851.694601:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+15:15092:x1874634253360896:12345-0@lo:101:mount.lustre.0 Request processed in 108us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790851.694608:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787790851.694668:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253360896:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787790851.694681:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97753c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97753c9 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790851.694690:0:15092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97753c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97753c9 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787790851.696978:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787790851.697886:0:15092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787790851.698169:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787790851.704114:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787790851.704295:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787790851.704305:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787790851.704426:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253361024:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787790851.704488:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790851.704530:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a478f1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787790851.705779:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253361024 00000100:00100000:1.0:1787790851.705789:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253361024 00000100:00100000:1.0:1787790851.705837:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787790851.705846:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+15:15092:x1874634253361024:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787790851.706111:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+15:15092:x1874634253361024:12345-0@lo:501:mount.lustre.0 Request processed in 265us (1623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790851.706119:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787790851.706229:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253361024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787790851.706275:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253361152:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787790851.706319:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790851.706351:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a42f60900 going to sleep for 11 seconds 00000100:00100000:2.0:1787790851.706541:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253361152 00000100:00100000:2.0:1787790851.706546:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253361152 00000100:00100000:2.0:1787790851.706671:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787790851.706678:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+15:15092:x1874634253361152:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787790851.706871:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+15:15092:x1874634253361152:12345-0@lo:503:mount.lustre.0 Request processed in 193us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790851.706878:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787790851.706976:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253361152:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787790851.707876:0:15092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787790851.707949:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253361280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787790851.707998:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790851.713784:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a44ef5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790851.713861:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253361280 00000100:00100000:3.0:1787790851.713870:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253361280 00000100:00100000:3.0:1787790851.713925:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787790851.713935:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+15:15092:x1874634253361280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787790851.714310:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+15:15092:x1874634253361280:12345-0@lo:502:mount.lustre.0 Request processed in 376us (6310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790851.714318:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787790851.714642:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253361280:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787790851.714954:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787790851.715021:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787790851.715090:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787790851.719385:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787790851.719513:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787790851.719597:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787790851.719651:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787790851.719687:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787790851.719768:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253361408:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787790851.719850:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790851.719896:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a44ef5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790851.719975:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253361408 00000100:00100000:3.0:1787790851.719982:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253361408 00000100:00100000:3.0:1787790851.720021:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787790851.720029:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+15:15092:x1874634253361408:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787790851.721459:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+15:15092:x1874634253361408:12345-0@lo:502:mount.lustre.0 Request processed in 1425us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790851.721472:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787790851.722295:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253361408:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787790851.722489:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787790851.722506:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787790851.723714:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790851.723758:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790851.723761:0:15110:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787790851.723769:0:15110:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff931a5ffca000 00000020:00000080:2.0:1787790851.723772:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787790851.723781:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790851.723783:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790851.723785:0:15110:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787790851.723787:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790851.723789:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790851.723791:0:15110:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787790851.723794:0:15110:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff931a5ffca000 00000020:00000080:2.0:1787790851.723796:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787790851.726636:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790851.726648:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790851.726650:0:15110:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787790851.726656:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790851.726659:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790851.726661:0:15110:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787790851.726666:0:15110:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff931a5ffca000 00000020:00000080:2.0:1787790851.726668:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787790851.727435:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790851.727442:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790851.727444:0:15110:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787790851.727448:0:15110:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787790851.734848:0:15092:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787790851.734896:0:15092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787790851.734915:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97753c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97753c9 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790851.734929:0:15092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97753c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97753c9 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790851.735005:0:15092:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787790851.735009:0:15092:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff931a5ffca000 10000000:01000000:1.0:1787790851.735013:0:15092:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff931a5ffca000 10000000:01000000:1.0:1787790851.735017:0:15092:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787790851.735023:0:15092:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff931a5ffca000 from 1 10000000:01000000:1.0:1787790851.735025:0:15092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787790851.735064:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97753d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790851.735073:0:15092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97753d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790851.735084:0:15092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97753d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790851.735110:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253361536:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787790851.735399:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790851.745676:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a44ef5900 going to sleep for 11 seconds 00000100:00100000:3.0:1787790851.746288:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253361536 00000100:00100000:3.0:1787790851.746298:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253361536 00000100:00100000:3.0:1787790851.746358:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787790851.746368:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+15:15092:x1874634253361536:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787790851.746385:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790851.746404:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a82153800/0x70647b5fa97753d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97753d0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790851.746433:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a82153800/0x70647b5fa97753d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97753d0 expref: 16 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790851.746444:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a82153800/0x70647b5fa97753d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97753d0 expref: 16 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790851.746464:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153800, rc 0) 00000100:00100000:3.0:1787790851.746528:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+16:15092:x1874634253361536:12345-0@lo:101:mount.lustre.0 Request processed in 161us (11128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790851.746535:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787790851.748010:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253361536:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787790851.748033:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97753d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97753d7 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790851.748045:0:15092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97753d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97753d7 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787790851.748700:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787790851.749179:0:15092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787790851.749435:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787790851.749485:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787790851.749523:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787790851.749573:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787790851.749611:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787790851.749680:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787790851.749719:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787790851.749782:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787790851.749848:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787790851.749886:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787790851.749917:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787790851.749959:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787790851.749995:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787790851.750030:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787790851.750080:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787790851.750118:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787790851.750154:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787790851.750201:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787790851.750237:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787790851.750272:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787790851.750334:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787790851.750369:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787790851.750400:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787790851.750443:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787790851.750496:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787790851.750531:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787790851.750580:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787790851.750632:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787790851.750708:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787790851.750716:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787790851.750830:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253361664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787790851.750891:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790851.750931:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a44ef5900 going to sleep for 11 seconds 00000100:00100000:0.0:1787790851.756808:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253361664 00000100:00100000:0.0:1787790851.756823:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253361664 00000100:00100000:0.0:1787790851.756885:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787790851.756895:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+16:15092:x1874634253361664:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787790851.757269:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+16:15092:x1874634253361664:12345-0@lo:501:mount.lustre.0 Request processed in 375us (6376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790851.757277:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787790851.761396:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253361664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787790851.761455:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253361792:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787790851.761533:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790851.761578:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a44ef5900 going to sleep for 11 seconds 00000100:00100000:0.0:1787790851.762304:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253361792 00000100:00100000:0.0:1787790851.762312:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253361792 00000100:00100000:0.0:1787790851.762362:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787790851.762371:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d73c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+16:15092:x1874634253361792:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787790851.762573:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d73c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+16:15092:x1874634253361792:12345-0@lo:503:mount.lustre.0 Request processed in 202us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790851.762582:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787790851.762850:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253361792:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787790851.763493:0:15092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787790851.763563:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253361920:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787790851.763613:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790851.763663:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a478503c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790851.763756:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253361920 00000100:00100000:2.0:1787790851.763762:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253361920 00000100:00100000:2.0:1787790851.763795:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787790851.763803:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d73e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+16:15092:x1874634253361920:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787790851.763982:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d73e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+16:15092:x1874634253361920:12345-0@lo:502:mount.lustre.0 Request processed in 179us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790851.763990:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787790851.764882:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253361920:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787790851.765168:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787790851.765652:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787790851.765693:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787790851.765829:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787790851.765887:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787790851.765935:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787790851.765972:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787790851.766006:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787790851.766054:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787790851.766090:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787790851.766123:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787790851.767412:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787790851.767455:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787790851.767489:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787790851.767537:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787790851.767573:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787790851.767608:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787790851.767670:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787790851.767709:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787790851.767776:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787790851.767853:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787790851.767889:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787790851.767925:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787790851.767971:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787790851.768008:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787790851.768040:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787790851.768082:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787790851.768119:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787790851.773123:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787790851.773629:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787790851.773670:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787790851.773708:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787790851.773783:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787790851.773834:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787790851.773873:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787790851.773924:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787790851.773961:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787790851.773998:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787790851.774064:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787790851.774105:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787790851.774169:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253362048:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787790851.774367:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790851.774453:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a42f60f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790851.774883:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253362048 00000100:00100000:2.0:1787790851.774890:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253362048 00000100:00100000:2.0:1787790851.774931:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787790851.774939:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d73c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+16:15092:x1874634253362048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787790851.775361:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d73c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+16:15092:x1874634253362048:12345-0@lo:502:mount.lustre.0 Request processed in 421us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790851.775371:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787790851.775973:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253362048:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787790851.776079:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787790851.776099:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787790851.778629:0:15115:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787790851.778647:0:15115:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff931a42f2cd28) 00000020:00000080:3.0:1787790851.778674:0:15115:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787790851.778791:0:15115:0:(tgt_mount.c:153:server_get_mount()) get mount ffff931a5ffca000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787790851.778796:0:15115:0:(tgt_mount.c:187:server_put_mount()) put mount ffff931a5ffca000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787790851.778799:0:15115:0:(obd_mount.c:710:lustre_put_lsi()) put ffff931a5ffca000 3 00010000:00080000:3.0:1787790851.778831:0:15115:0:(ldlm_lib.c:102:import_set_conn()) imp ffff931a42e73000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.125@tcp at head 00010000:00010000:3.0:1787790851.781473:0:15115:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1787790851.781764:0:15115:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787790851.781810:0:15115:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787790851.781823:0:15115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x70647b5fa97753e5 00000100:00080000:3.0:1787790851.781834:0:15115:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787790851.781840:0:15115:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff931a42e73000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:3.0:1787790851.781875:0:15115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93194581ed00 x1874634253362176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787790851.781904:0:15115:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787790851.781927:0:13164:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787790851.781932:0:13164:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787790851.781935:0:13164:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787790851.781938:0:13164:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787790851.781982:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253362304:0@lo:400:kworker.0 00000100:00100000:3.0:1787790851.782048:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790851.782119:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253362304 00000100:00100000:3.0:1787790851.782124:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253362304 00000100:00100000:2.0:1787790851.782285:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1874634253362176:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787790851.782320:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790851.782420:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790851.782431:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253362304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790851.785451:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253362304:12345-0@lo:400:kworker.0 Request processed in 3012us (3392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790851.785467:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790851.785504:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253362176 00000100:00100000:3.0:1787790851.785511:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253362176 00000100:00100000:3.0:1787790851.785535:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787790851.785540:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1874634253362176:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787790851.785585:0:14411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 386 last 0 00000020:00000080:3.0:1787790851.785651:0:14411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x70647b5fa97753ec 00000004:00100000:3.0:1787790851.785668:0:14411:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787790851.785698:0:14411:0:(import.c:65:import_set_state_nolock()) ffff931945afd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790851.785787:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874634253362176:12345-0@lo:38:llog_process_th.0 Request processed in 244us (3465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790851.785794:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787790851.787416:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93194581e1c0 x1874634253362304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790851.787434:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253362304:0@lo:400:kworker.0 00010000:00080000:1.0:1787790851.787605:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93194581ed00 x1874634253362176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787790861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790851.787625:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787790851.787640:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787790851.787647:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787790851.787652:0:3317:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787790851.787654:0:3317:0:(import.c:65:import_set_state_nolock()) ffff931a42e73000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787790851.787660:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1874634253362176:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787790851.787711:0:15115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787790851.788218:0:15092:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787790851.788262:0:15092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787790851.788292:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97753d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97753d7 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790851.788303:0:15092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a45705000/0x70647b5fa97753d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97753d7 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787790851.788353:0:15092:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787790851.788356:0:15092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787790851.788357:0:15092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790851.788358:0:15092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790851.788359:0:15092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790851.788362:0:15092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790851.788363:0:15092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787790851.788365:0:15092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790851.788366:0:15092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787790851.788369:0:15092:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787790851.788372:0:15092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787790851.788373:0:15092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787790851.788374:0:15092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790851.788375:0:15092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790851.788376:0:15092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790851.788377:0:15092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790851.788379:0:15092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787790851.788380:0:15092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790851.788381:0:15092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787790851.788403:0:15092:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787790851.788420:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf10780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253362432:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787790851.788506:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790851.788539:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a44ef5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787790851.788924:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253362432 00000100:00100000:0.0:1787790851.788932:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253362432 00000100:00100000:0.0:1787790851.788976:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787790851.788984:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d73ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+16:15092:x1874634253362432:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787790851.789008:0:14405:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787790851.789021:0:14405:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787790851.821852:0:14405:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787790851.821906:0:14405:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787790851.824604:0:14427:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787790851.824622:0:14427:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787790851.824646:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff931a45704e00/0x70647b5fa97753f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790851.824665:0:14427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a45704c00/0x70647b5fa9775360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9775359 expref: 16 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790851.824690:0:14427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff931a45704e00/0x70647b5fa97753f3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790851.824760:0:14427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a45704c00/0x70647b5fa9775360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa9775359 expref: 16 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790851.824774:0:14427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff931a45704c00/0x70647b5fa9775360 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa9775359 expref: 16 pid: 14406 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790851.824789:0:14427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf12580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14427:1874634253362560:0@lo:104: 00000100:00100000:1.0:1787790851.824855:0:14427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790851.824897:0:14427:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a44ef5240 going to sleep for 11 seconds 00000100:00100000:3.0:1787790851.825025:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253362560 00000100:00100000:3.0:1787790851.825033:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253362560 00000100:00100000:3.0:1787790851.825086:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787790851.825095:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf121c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8529acdd-b606-48f0-be71-c40064ed5481+3:14427:x1874634253362560:12345-0@lo:104: 00010000:00010000:3.0:1787790851.825109:0:14396:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa9775359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9775360 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790851.825171:0:14396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787790851.825187:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf121c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8529acdd-b606-48f0-be71-c40064ed5481+3:14427:x1874634253362560:12345-0@lo:104: Request processed in 94us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790851.825193:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787790851.825225:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790851.825239:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa9775359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9775360 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790851.825247:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f200 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:3.0:1787790851.825251:0:14400:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa9775359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa9775360 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790851.825260:0:14400:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa9775359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa9775360 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790851.825268:0:14400:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa9775359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa9775360 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790851.825282:0:14400:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787790851.825313:0:14400:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa9775359 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9775360 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790851.825319:0:14400:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787790851.825338:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa9775359 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9775360 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790851.825345:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa9775359 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9775360 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790851.825360:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790851.825363:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790851.825364:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790851.825383:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8529acdd-b606-48f0-be71-c40064ed5481:3319:1874634253362688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787790851.825413:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790851.825452:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253362688 00000100:00100000:3.0:1787790851.825456:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253362688 00010000:00010000:3.0:1787790851.825474:0:14398:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a45704c00/0x70647b5fa9775360 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9775359 expref: 17 pid: 14406 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790851.825494:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787790851.825500:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8529acdd-b606-48f0-be71-c40064ed5481+17:3319:x1874634253362688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787790851.825509:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790851.825514:0:14398:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a45704c00/0x70647b5fa9775360 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9775359 expref: 17 pid: 14406 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790851.825523:0:14398:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a45704c00/0x70647b5fa9775360 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa9775359 expref: 17 pid: 14406 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790851.825546:0:14398:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff931a45704e00/0x70647b5fa97753f3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790851.825552:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a45704e00/0x70647b5fa97753f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787790851.825564:0:14398:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004831467s 00010000:00010000:3.0:1787790851.825568:0:14398:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a45704e00/0x70647b5fa97753f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790851.825575:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a45704e00/0x70647b5fa97753f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790851.825582:0:14398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff931a45704e00/0x70647b5fa97753f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790851.825587:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff931a45704e00/0x70647b5fa97753f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790851.825592:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704e00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790851.825596:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff931a45704e00/0x70647b5fa97753f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790851.825603:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff931a45704e00/0x70647b5fa97753f3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790851.825611:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff931a45704e00/0x70647b5fa97753f3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790851.825629:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790851.825658:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8529acdd-b606-48f0-be71-c40064ed5481+17:3319:x1874634253362688:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790851.825671:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787790851.825710:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8529acdd-b606-48f0-be71-c40064ed5481:3319:1874634253362688:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790851.825889:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a45704c00/0x70647b5fa9775360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa9775359 expref: 16 pid: 14406 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790851.825900:0:14427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf12580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14427:1874634253362560:0@lo:104: 00010000:00010000:0.0:1787790851.825913:0:14427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff931a45704e00/0x70647b5fa97753f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790851.825921:0:14427:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff931a45704e00/0x70647b5fa97753f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790851.825926:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff931a45704e00/0x70647b5fa97753f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790851.825932:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a45704e00/0x70647b5fa97753f3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790851.833394:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d73ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+15:15092:x1874634253362432:12345-0@lo:253:mount.lustre.0 Request processed in 44399us (44877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790851.833410:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787790851.833565:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf10780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15092:1874634253362432:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787790851.833665:0:15092:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787790851.833668:0:15092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787790851.833670:0:15092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787790851.833671:0:15092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790851.833673:0:15092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790851.833674:0:15092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790851.833675:0:15092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790851.833676:0:15092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787790851.833677:0:15092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790851.833679:0:15092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787790851.833694:0:15092:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787790851.842515:0:15092:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787790851.843763:0:15092:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787790851.843945:0:15092:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787790851.844113:0:15092:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787790851.844561:0:15092:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787790851.846995:0:15092:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787790851.848040:0:15092:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787790851.905048:0:15092:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787790851.905057:0:15092:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787790851.905105:0:15092:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787790851.905190:0:15092:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787790851.905205:0:15092:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787790851.905363:0:15092:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787790852.224954:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787790852.482885:0:14444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1787790853.055837:0:14409:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787790853.055849:0:14409:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff931a4b638800 from 7 10000000:01000000:3.0:1787790853.055856:0:14409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787790853.055915:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a82153a00/0x70647b5fa97753fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790853.055929:0:14409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a82153a00/0x70647b5fa97753fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790853.055942:0:14409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a82153a00/0x70647b5fa97753fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790853.055974:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253362816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787790853.056060:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790853.056123:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4cbf5840 going to sleep for 11 seconds 00000100:00100000:0.0:1787790853.056226:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253362816 00000100:00100000:0.0:1787790853.056234:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253362816 00000100:00100000:0.0:1787790853.056300:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787790853.056311:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d73c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+15:14409:x1874634253362816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790853.056327:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790853.056343:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a67980e00/0x70647b5fa9775401 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97753fa expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790853.056380:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a67980e00/0x70647b5fa9775401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97753fa expref: 16 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790853.056393:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a67980e00/0x70647b5fa9775401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97753fa expref: 16 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790853.056405:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67980e00, rc 0) 00000100:00100000:0.0:1787790853.056456:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d73c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+16:14409:x1874634253362816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790853.056473:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787790853.056910:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253362816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790853.056930:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a82153a00/0x70647b5fa97753fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775401 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790853.056941:0:14409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a82153a00/0x70647b5fa97753fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9775401 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790853.057017:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253362944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787790853.057059:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790853.057085:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a44ef5780 going to sleep for 11 seconds 00000100:00100000:3.0:1787790853.057137:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253362944 00000100:00100000:3.0:1787790853.057142:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253362944 00000100:00100000:3.0:1787790853.057185:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787790853.057194:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d73e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+16:14409:x1874634253362944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787790853.057220:0:14405:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787790853.057240:0:14405:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787790853.057244:0:14405:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787790853.057340:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d73e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+16:14409:x1874634253362944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 147us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790853.057347:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787790853.057651:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253362944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787790853.057742:0:14409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787790853.057750:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a82153a00/0x70647b5fa97753fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775401 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790853.057759:0:14409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a82153a00/0x70647b5fa97753fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775401 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790853.248094:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790854.273173:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790855.295881:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790856.330688:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790857.286172:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8529acdd-b606-48f0-be71-c40064ed5481:3320:1874634253363072:0@lo:400:kworker.0 00000100:00100000:2.0:1787790857.286256:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787790857.286331:0:13164:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787790857.286337:0:13164:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787790857.286339:0:13164:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787790857.286342:0:13164:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787790857.287594:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253363072 00000100:00100000:0.0:1787790857.287605:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253363072 00000100:00100000:0.0:1787790857.287656:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787790857.287665:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a44c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+16:3320:x1874634253363072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790857.295830:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253363200:0@lo:400:kworker.0 00000100:00100000:1.0:1787790857.295923:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790857.296174:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a44c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+16:3320:x1874634253363072:12345-0@lo:400:kworker.0 Request processed in 8506us (9914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790857.296188:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787790857.296407:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787790857.296420:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1874634253363328:0@lo:400:kworker.0 00000100:00100000:1.0:1787790857.296454:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790857.296494:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253363200 00000100:00100000:1.0:1787790857.296502:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253363200 00000100:00100000:1.0:1787790857.296549:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253363328 00000100:00100000:1.0:1787790857.296566:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253363328 00000100:00100000:1.0:1787790857.296609:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787790857.296618:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253363200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790857.296672:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253363200:12345-0@lo:400:kworker.0 Request processed in 56us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790857.296678:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787790857.296698:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787790857.296717:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874634253363328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790857.296767:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874634253363328:12345-0@lo:400:kworker.0 Request processed in 63us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790857.296772:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787790857.296828:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a7bf11a40 x1874634253363328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790857.296842:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1874634253363328:0@lo:400:kworker.0 00010000:00080000:1.0:1787790857.296870:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a7bf12d00 x1874634253363200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790857.296879:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253363200:0@lo:400:kworker.0 00000100:00080000:0.0:1787790857.297435:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790857.300871:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8529acdd-b606-48f0-be71-c40064ed5481:3320:1874634253363072:0@lo:400:kworker.0 00010000:00010000:3.0:1787790857.346343:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787790857.802379:0:15459:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787790858.368867:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790859.397677:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790860.418836:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790861.439825:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787790862.407095:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787790862.407103:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787790862.407106:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787790862.407109:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787790862.407123:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787790862.407152:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8529acdd-b606-48f0-be71-c40064ed5481:3318:1874634253363456:0@lo:400:kworker.0 00000100:00100000:0.0:1787790862.407253:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790862.407325:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253363456 00000100:00100000:0.0:1787790862.407334:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253363456 00000100:00100000:0.0:1787790862.407408:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787790862.407417:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a44c2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+16:3318:x1874634253363456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790862.407490:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a44c2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+16:3318:x1874634253363456:12345-0@lo:400:kworker.0 Request processed in 72us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790862.407497:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787790862.408235:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8529acdd-b606-48f0-be71-c40064ed5481:3318:1874634253363456:0@lo:400:kworker.0 00000100:00100000:0.0:1787790862.408327:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253363584:0@lo:400:kworker.0 00000100:00100000:0.0:1787790862.408475:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790862.409643:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790862.409673:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253363712:0@lo:400:kworker.0 00000100:00100000:3.0:1787790862.409815:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790862.409872:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253363584 00000100:00100000:0.0:1787790862.409885:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253363584 00000100:00100000:0.0:1787790862.411279:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253363712 00000100:00100000:0.0:1787790862.411293:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253363712 00000100:00100000:0.0:1787790862.411412:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787790862.411425:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253363584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790862.411795:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787790862.411808:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787790862.411867:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874634253363584:12345-0@lo:400:kworker.0 Request processed in 445us (3392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790862.411877:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787790862.411900:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787790862.411907:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253363712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790862.411948:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253363712:12345-0@lo:400:kworker.0 Request processed in 33us (2124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790862.412402:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787790862.412425:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787790862.412489:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a7be18b40 x1874634253363712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790862.412713:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253363712:0@lo:400:kworker.0 00010000:00080000:0.0:1787790862.412791:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a7be1a940 x1874634253363584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790862.412802:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874634253363584:0@lo:400:kworker.0 00010000:00010000:2.0:1787790862.466383:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787790862.725448:0:14444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787790863.488808:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787790864.243397:0:15808:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787790864.243410:0:15808:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787790864.243522:0:15808:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff931945afb800 00000020:01000004:3.0:1787790864.243540:0:15808:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787790864.243553:0:15808:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787790864.243566:0:15808:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff931a493c4d28) 00000020:00000080:3.0:1787790864.243580:0:15808:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787790864.262613:0:15808:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787790864.262958:0:15808:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787790864.263876:0:15808:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787790864.264078:0:15808:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787790864.264254:0:15808:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787790864.264677:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 497: rc = 0 00100000:10000000:2.0:1787790864.264804:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 497: rc = 0 00100000:10000000:2.0:1787790864.264901:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 497: rc = 0 00100000:10000000:2.0:1787790864.265389:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:2.0:1787790864.265799:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1787790864.267999:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1787790864.268316:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1787790864.268963:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:2.0:1787790864.269235:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00000020:00000080:2.0:1787790864.272009:0:15808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787790864.272027:0:15808:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787790864.272044:0:15808:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x70647b5fa977540f 00000020:01000004:2.0:1787790864.272055:0:15808:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787790864.272078:0:15808:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.125@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787790864.272082:0:15808:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787790864.272089:0:15808:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787790864.272114:0:15808:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787790864.272119:0:15808:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.125@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787790864.282997:0:15808:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787790864.283048:0:15808:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.125@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787790864.283053:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787790864.283054:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787790864.283056:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787790864.283057:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787790864.283059:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787790864.283060:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787790864.283062:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787790864.283064:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787790864.283066:0:15808:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787790864.283069:0:15808:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787790864.283072:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787790864.283074:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787790864.283075:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787790864.283076:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787790864.283077:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787790864.283078:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787790864.283079:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787790864.283086:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787790864.283086:0:15808:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787790864.283113:0:15808:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787790864.283135:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253363840:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787790864.283220:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790864.283285:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a478f1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787790864.283297:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253363840 00000100:00100000:0.0:1787790864.283306:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253363840 00000100:00100000:0.0:1787790864.283381:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787790864.283391:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a44c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+16:15808:x1874634253363840:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787790864.283432:0:14405:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787790864.283442:0:14405:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787790864.283446:0:14405:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787790864.288448:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a44c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+16:15808:x1874634253363840:12345-0@lo:253:mount.lustre.0 Request processed in 5044us (5214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790864.288464:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787790864.288788:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253363840:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787790864.288803:0:15808:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787790864.288806:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787790864.288808:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787790864.288809:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787790864.288811:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787790864.288812:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787790864.288813:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787790864.288814:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787790864.288816:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787790864.288817:0:15808:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787790864.288838:0:15808:0:(tgt_mount.c:101:server_register_mount()) register mount ffff931945afb800 from lustre-OST0001 10000000:01000000:0.0:1787790864.288861:0:15808:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787790864.288864:0:15808:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787790864.288871:0:15808:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff931a44ec3370 local copy 00010000:00010000:0.0:1787790864.288881:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45705800/0x70647b5fa9775280 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775287 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790864.289136:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253363968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787790864.289180:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790864.289275:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4658ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790864.289612:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253363968 00000100:00100000:1.0:1787790864.289618:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253363968 00000100:00100000:1.0:1787790864.289773:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787790864.289783:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a44c28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+16:15808:x1874634253363968:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787790864.289970:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a44c28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+16:15808:x1874634253363968:12345-0@lo:501:mount.lustre.0 Request processed in 188us (789us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787790864.289988:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787790864.290058:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253363968:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787790864.290074:0:15808:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787790864.290223:0:15808:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787790864.290232:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45705800/0x70647b5fa9775280 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775287 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790864.290243:0:15808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a45705800/0x70647b5fa9775280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775287 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790864.290287:0:15808:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff931945afb800 10000000:01000000:0.0:1787790864.290293:0:15808:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787790864.290299:0:15808:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787790864.290301:0:15808:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787790864.290306:0:15808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787790864.290309:0:15808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787790864.290337:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a67980200/0x70647b5fa9775416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790864.290345:0:15808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a67980200/0x70647b5fa9775416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790864.290354:0:15808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a67980200/0x70647b5fa9775416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790864.290370:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253364096:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787790864.290412:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790864.291026:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4658ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790864.291168:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253364096 00000100:00100000:2.0:1787790864.291175:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253364096 00000100:00100000:2.0:1787790864.291212:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787790864.291220:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a44c2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+16:15808:x1874634253364096:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787790864.291234:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790864.291251:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a4654e200/0x70647b5fa977541d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9775416 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790864.291292:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a4654e200/0x70647b5fa977541d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9775416 expref: 17 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790864.291303:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a4654e200/0x70647b5fa977541d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9775416 expref: 17 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790864.291313:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654e200, rc 0) 00000100:00100000:2.0:1787790864.291364:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a44c2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+17:15808:x1874634253364096:12345-0@lo:101:mount.lustre.0 Request processed in 145us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790864.291370:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787790864.291495:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253364096:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787790864.291510:0:15808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a67980200/0x70647b5fa9775416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977541d expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790864.291519:0:15808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a67980200/0x70647b5fa9775416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa977541d expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787790864.292167:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787790864.293023:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787790864.293260:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787790864.293313:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787790864.293347:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787790864.293408:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787790864.293450:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787790864.293480:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787790864.293538:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787790864.293546:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787790864.293630:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253364224:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787790864.293699:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790864.293749:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4658e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790864.293926:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253364224 00000100:00100000:2.0:1787790864.293933:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253364224 00000100:00100000:2.0:1787790864.293977:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787790864.293986:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a44c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+17:15808:x1874634253364224:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787790864.294341:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a44c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+17:15808:x1874634253364224:12345-0@lo:501:mount.lustre.0 Request processed in 356us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790864.294350:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787790864.295863:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253364224:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787790864.296082:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253364352:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787790864.296157:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790864.296197:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4658e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790864.296421:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253364352 00000100:00100000:2.0:1787790864.296428:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253364352 00000100:00100000:2.0:1787790864.296488:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787790864.296497:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+17:15808:x1874634253364352:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787790864.297273:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+17:15808:x1874634253364352:12345-0@lo:503:mount.lustre.0 Request processed in 459us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790864.297286:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787790864.298629:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253364352:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787790864.299472:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787790864.299561:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253364480:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787790864.299645:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790864.299699:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4658e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790864.300103:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253364480 00000100:00100000:2.0:1787790864.300112:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253364480 00000100:00100000:2.0:1787790864.300171:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787790864.300180:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+17:15808:x1874634253364480:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787790864.300507:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+17:15808:x1874634253364480:12345-0@lo:502:mount.lustre.0 Request processed in 325us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790864.300515:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787790864.301375:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253364480:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787790864.302125:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787790864.302188:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787790864.302223:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787790864.302344:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787790864.302383:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787790864.302429:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787790864.302495:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787790864.302544:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787790864.302593:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787790864.302640:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253364608:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787790864.302753:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790864.302800:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4658e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790864.302934:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253364608 00000100:00100000:3.0:1787790864.302940:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253364608 00000100:00100000:3.0:1787790864.303155:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787790864.303165:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+17:15808:x1874634253364608:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787790864.303592:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253364608:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787790864.303677:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1787790864.303689:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000100:00100000:3.0:1787790864.304259:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+17:15808:x1874634253364608:12345-0@lo:502:mount.lustre.0 Request processed in 225us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790864.304270:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000020:01000000:3.0:1787790864.305603:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787790864.305614:0:15809:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787790864.305621:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790864.305623:0:15809:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787790864.305629:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787790864.305645:0:15809:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff931a493c0000) 00000020:00000080:3.0:1787790864.305669:0:15809:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787790864.305674:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787790864.306101:0:15809:0:(tgt_mount.c:153:server_get_mount()) get mount ffff931945afb800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787790864.306110:0:15809:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787790864.306117:0:15809:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x70647b5fa977542b 00010000:00010000:3.0:1787790864.311675:0:15809:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1787790864.312347:0:15809:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1787790864.317564:0:15809:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787790864.319408:0:15809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787790864.319421:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790864.319427:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790864.319429:0:15809:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787790864.319433:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790864.319436:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790864.319438:0:15809:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787790864.319441:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787790864.319443:0:15809:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787790864.319445:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790864.319447:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790864.319448:0:15809:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787790864.319451:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790864.319453:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790864.319454:0:15809:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787790864.319458:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787790864.319519:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790864.319523:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790864.319524:0:15809:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787790864.319527:0:15809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1787790864.319688:0:15808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787790864.319714:0:15808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787790864.319762:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a67980200/0x70647b5fa9775416 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977541d expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790864.319774:0:15808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a67980200/0x70647b5fa9775416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa977541d expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790864.319782:0:15808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff931945afb800 from 1 10000000:01000000:1.0:1787790864.319785:0:15808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787790864.319825:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45704800/0x70647b5fa9775432 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790864.319832:0:15808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a45704800/0x70647b5fa9775432 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790864.319841:0:15808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a45704800/0x70647b5fa9775432 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790864.319865:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf11a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253364736:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787790864.319944:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790864.320207:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4cbb2000 going to sleep for 11 seconds 00000100:00100000:2.0:1787790864.321200:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253364736 00000100:00100000:2.0:1787790864.321209:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253364736 00000100:00100000:2.0:1787790864.321262:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787790864.321271:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194467c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+17:15808:x1874634253364736:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787790864.321286:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790864.321302:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a4654fe00/0x70647b5fa9775439 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9775432 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790864.321327:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a4654fe00/0x70647b5fa9775439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9775432 expref: 18 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790864.321337:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a4654fe00/0x70647b5fa9775439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9775432 expref: 18 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790864.321344:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654fe00, rc 0) 00000100:00100000:2.0:1787790864.321420:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194467c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+18:15808:x1874634253364736:12345-0@lo:101:mount.lustre.0 Request processed in 149us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790864.321427:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787790864.321554:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf11a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253364736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787790864.321572:0:15808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a45704800/0x70647b5fa9775432 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775439 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790864.321581:0:15808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a45704800/0x70647b5fa9775432 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9775439 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787790864.322689:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787790864.323387:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787790864.323638:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787790864.323683:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787790864.324160:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787790864.324173:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787790864.324273:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253364864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787790864.324351:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790864.324409:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4658e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790864.326106:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253364864 00000100:00100000:3.0:1787790864.326119:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253364864 00000100:00100000:3.0:1787790864.326189:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787790864.326199:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+18:15808:x1874634253364864:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787790864.326524:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194467c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+18:15808:x1874634253364864:12345-0@lo:501:mount.lustre.0 Request processed in 325us (2172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790864.326532:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787790864.326990:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253364864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787790864.327048:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253364992:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787790864.327100:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790864.327140:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4658e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790864.334189:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253364992 00000100:00100000:3.0:1787790864.334209:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253364992 00000100:00100000:3.0:1787790864.334268:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787790864.334278:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+18:15808:x1874634253364992:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787790864.334571:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194467f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+18:15808:x1874634253364992:12345-0@lo:503:mount.lustre.0 Request processed in 294us (7470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790864.334579:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787790864.334717:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253364992:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787790864.335665:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787790864.336937:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253365120:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787790864.337937:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790864.338149:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4658e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790864.341589:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253365120 00000100:00100000:3.0:1787790864.341612:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253365120 00000100:00100000:3.0:1787790864.341758:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787790864.341769:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+18:15808:x1874634253365120:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787790864.342688:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+18:15808:x1874634253365120:12345-0@lo:502:mount.lustre.0 Request processed in 916us (4755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790864.342699:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787790864.342869:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253365120:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787790864.343164:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787790864.343223:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787790864.343271:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787790864.343318:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787790864.343369:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787790864.343435:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787790864.343479:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787790864.343522:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787790864.343568:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf103c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253365248:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787790864.343634:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790864.344937:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253365248 00000100:00100000:0.0:1787790864.344947:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253365248 00000100:00100000:1.0:1787790864.344954:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a488cbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790864.344991:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787790864.345000:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+18:15808:x1874634253365248:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787790864.345620:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+18:15808:x1874634253365248:12345-0@lo:502:mount.lustre.0 Request processed in 618us (1984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790864.345653:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf103c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253365248:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787790864.346011:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000040:00080000:1.0:1787790864.346048:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787790864.346067:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787790864.347527:0:15813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790864.347539:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790864.347541:0:15813:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787790864.347548:0:15813:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff931945afb800 00000020:00000080:2.0:1787790864.347550:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787790864.347556:0:15813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790864.347562:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790864.347564:0:15813:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787790864.347565:0:15813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790864.347567:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790864.347568:0:15813:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787790864.347569:0:15813:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff931945afb800 00000020:00000080:2.0:1787790864.347571:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787790864.347625:0:15813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790864.347628:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790864.347630:0:15813:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787790864.347632:0:15813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790864.347635:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790864.347636:0:15813:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787790864.347639:0:15813:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff931945afb800 00000020:00000080:2.0:1787790864.347642:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787790864.347679:0:15813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790864.347683:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790864.347684:0:15813:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787790864.347687:0:15813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787790864.347869:0:15808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787790864.348096:0:15808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787790864.348440:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a45704800/0x70647b5fa9775432 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775439 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790864.348455:0:15808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a45704800/0x70647b5fa9775432 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775439 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790864.348504:0:15808:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787790864.348509:0:15808:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff931945afb800 10000000:01000000:0.0:1787790864.348512:0:15808:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff931945afb800 10000000:01000000:0.0:1787790864.348518:0:15808:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787790864.348526:0:15808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff931945afb800 from 1 10000000:01000000:0.0:1787790864.348530:0:15808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787790864.348572:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a67980c00/0x70647b5fa9775440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790864.348591:0:15808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a67980c00/0x70647b5fa9775440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790864.348604:0:15808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a67980c00/0x70647b5fa9775440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790864.348631:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253365376:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787790864.348701:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790864.348835:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4658e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790864.348904:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253365376 00000100:00100000:2.0:1787790864.348912:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253365376 00000100:00100000:2.0:1787790864.349056:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787790864.349067:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+18:15808:x1874634253365376:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787790864.349081:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790864.349097:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a4654f800/0x70647b5fa9775447 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa9775440 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790864.349124:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a4654f800/0x70647b5fa9775447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa9775440 expref: 19 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790864.349136:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a4654f800/0x70647b5fa9775447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9775440 expref: 19 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790864.349157:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654f800, rc 0) 00000100:00100000:2.0:1787790864.349208:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+19:15808:x1874634253365376:12345-0@lo:101:mount.lustre.0 Request processed in 143us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790864.349216:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787790864.349245:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253365376:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787790864.349262:0:15808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a67980c00/0x70647b5fa9775440 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775447 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790864.349272:0:15808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a67980c00/0x70647b5fa9775440 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9775447 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787790864.350005:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1787790864.350437:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787790864.351431:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787790864.351517:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787790864.351573:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787790864.351648:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787790864.351689:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787790864.351756:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787790864.351814:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787790864.351855:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787790864.351914:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787790864.351954:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787790864.351997:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787790864.352064:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787790864.352105:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787790864.352145:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787790864.352210:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787790864.352411:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787790864.352450:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787790864.352495:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787790864.352527:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787790864.352558:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787790864.352602:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787790864.352638:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787790864.352688:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787790864.352991:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787790864.353031:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787790864.353062:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787790864.353106:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787790864.353142:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787790864.353175:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787790864.353221:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1787790864.353433:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1787790864.353469:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1787790864.353503:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1787790864.353551:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1787790864.353585:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1787790864.353637:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1787790864.353677:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1787790864.353876:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1787790864.353886:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1787790864.354039:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253365504:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787790864.354111:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790864.354218:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4658e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790864.354389:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253365504 00000100:00100000:3.0:1787790864.354405:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253365504 00000100:00100000:3.0:1787790864.354483:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787790864.354492:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+19:15808:x1874634253365504:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787790864.354751:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+19:15808:x1874634253365504:12345-0@lo:501:mount.lustre.0 Request processed in 260us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790864.354760:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787790864.355466:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253365504:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787790864.355505:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253365632:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787790864.355554:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790864.355583:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253365632 00000100:00100000:0.0:1787790864.355588:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253365632 00000100:00100000:0.0:1787790864.355617:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787790864.355625:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+19:15808:x1874634253365632:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787790864.355778:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+19:15808:x1874634253365632:12345-0@lo:503:mount.lustre.0 Request processed in 153us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790864.355785:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787790864.355826:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4658e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790864.355839:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253365632:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787790864.356424:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787790864.356485:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253365760:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787790864.356527:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790864.356555:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253365760 00000100:00100000:0.0:1787790864.356559:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253365760 00000100:00100000:0.0:1787790864.356586:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787790864.356593:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+19:15808:x1874634253365760:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787790864.357462:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+19:15808:x1874634253365760:12345-0@lo:502:mount.lustre.0 Request processed in 863us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790864.357473:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787790864.357538:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4658e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790864.357562:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253365760:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787790864.357890:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787790864.357955:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787790864.357992:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787790864.358044:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787790864.358081:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787790864.358134:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787790864.358173:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787790864.358208:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787790864.358513:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787790864.358564:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787790864.358600:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787790864.358651:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787790864.358696:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787790864.358831:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787790864.358902:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787790864.358956:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787790864.358996:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787790864.359043:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787790864.359079:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787790864.359118:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787790864.359195:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787790864.359409:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787790864.359460:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787790864.359536:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787790864.359588:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787790864.359634:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787790864.359696:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787790864.359876:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787790864.359932:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787790864.359999:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787790864.360033:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787790864.360067:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787790864.360101:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787790864.360167:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787790864.360232:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787790864.360456:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787790864.360508:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787790864.360556:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787790864.360628:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787790864.360689:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787790864.360777:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253365888:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787790864.360862:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790864.360904:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253365888 00000100:00100000:0.0:1787790864.360910:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253365888 00000100:00100000:0.0:1787790864.360959:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787790864.360967:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+19:15808:x1874634253365888:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787790864.361211:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+19:15808:x1874634253365888:12345-0@lo:502:mount.lustre.0 Request processed in 245us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790864.361219:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787790864.361425:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4658e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790864.361450:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253365888:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787790864.361522:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787790864.361533:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787790864.371598:0:15816:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787790864.371617:0:15816:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff931a493c19b8) 00000020:00000080:3.0:1787790864.371640:0:15816:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1787790864.371717:0:15816:0:(tgt_mount.c:153:server_get_mount()) get mount ffff931945afb800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787790864.371750:0:15816:0:(tgt_mount.c:187:server_put_mount()) put mount ffff931945afb800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787790864.371755:0:15816:0:(obd_mount.c:710:lustre_put_lsi()) put ffff931945afb800 3 00010000:00080000:3.0:1787790864.371788:0:15816:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9319446e3800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.125@tcp at head 00010000:00010000:0.0:1787790864.377021:0:15816:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1787790864.377288:0:15816:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787790864.377346:0:15816:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787790864.377868:0:15816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x70647b5fa9775455 00000100:00080000:0.0:1787790864.377882:0:15816:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787790864.377890:0:15816:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9319446e3800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1787790864.377947:0:15816:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931a7be1a1c0 x1874634253366016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787790864.377975:0:15816:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787790864.378007:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787790864.378012:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787790864.378014:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787790864.378017:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787790864.378065:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253366144:0@lo:400:kworker.0 00000100:00100000:0.0:1787790864.378129:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790864.378171:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787790864.378173:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253366144 00000100:00100000:0.0:1787790864.378179:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253366272:0@lo:400:kworker.0 00000100:00100000:2.0:1787790864.378182:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253366144 00000100:00100000:0.0:1787790864.378210:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790864.378319:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253366272 00000100:00100000:2.0:1787790864.378323:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253366272 00000100:00100000:2.0:1787790864.378451:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787790864.378464:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253366144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790864.378521:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253366144:12345-0@lo:400:kworker.0 Request processed in 61us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790864.378529:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787790864.378545:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787790864.378553:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253366272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790864.378584:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253366272:12345-0@lo:400:kworker.0 Request processed in 33us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790864.378590:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1787790864.378617:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787790864.378648:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a7be18000 x1874634253366272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790864.378663:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253366272:0@lo:400:kworker.0 00010000:00080000:2.0:1787790864.378677:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a7be1a580 x1874634253366144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790864.378688:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253366144:0@lo:400:kworker.0 00000040:00080000:0.0:1787790864.378703:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1787790864.378806:0:15808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787790864.378845:0:15808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787790864.378863:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a67980c00/0x70647b5fa9775440 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775447 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790864.378874:0:15808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a67980c00/0x70647b5fa9775440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775447 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787790864.378922:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787790864.378925:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787790864.378926:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787790864.378928:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787790864.378929:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787790864.378931:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787790864.378932:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787790864.378934:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787790864.378936:0:15808:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787790864.378939:0:15808:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787790864.378942:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787790864.378944:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787790864.378945:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787790864.378946:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787790864.378947:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787790864.378949:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787790864.378950:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787790864.378951:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787790864.378953:0:15808:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787790864.378995:0:15808:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787790864.379011:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253366400:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787790864.379053:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790864.379076:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1874634253366016:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787790864.379086:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a42f60900 going to sleep for 11 seconds 00000100:00100000:0.0:1787790864.379101:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253366400 00000100:00100000:0.0:1787790864.379107:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253366400 00000100:00100000:1.0:1787790864.379116:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790864.379143:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787790864.379153:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+19:15808:x1874634253366400:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787790864.379179:0:14405:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787790864.379197:0:14405:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787790864.379222:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253366016 00000100:00100000:2.0:1787790864.379227:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253366016 00000100:00100000:2.0:1787790864.379333:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787790864.379345:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3317:x1874634253366016:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787790864.379452:0:14413:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 399 last 0 00000020:00000080:2.0:1787790864.379498:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x70647b5fa977545c 00000004:00100000:2.0:1787790864.379518:0:14413:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787790864.379560:0:14413:0:(import.c:65:import_set_state_nolock()) ffff931945afc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787790864.379616:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874634253366016:12345-0@lo:38:llog_process_th.0 Request processed in 270us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790864.379623:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787790864.380742:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931a7be1a1c0 x1874634253366016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787790874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790864.380762:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787790864.380770:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787790864.380778:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787790864.380784:0:3317:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787790864.380787:0:3317:0:(import.c:65:import_set_state_nolock()) ffff9319446e3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787790864.380794:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1874634253366016:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1787790864.413860:0:14405:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787790864.413892:0:14405:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787790864.414039:0:14427:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787790864.414045:0:14427:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787790864.414073:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff931a4654f000/0x70647b5fa9775463 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790864.414094:0:14427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a67980e00/0x70647b5fa9775401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97753fa expref: 19 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790864.414104:0:14427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff931a4654f000/0x70647b5fa9775463 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790864.414160:0:14427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a67980e00/0x70647b5fa9775401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa97753fa expref: 19 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790864.414178:0:14427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff931a67980e00/0x70647b5fa9775401 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa97753fa expref: 19 pid: 14406 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790864.414195:0:14427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befe1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14427:1874634253366528:0@lo:104: 00000100:00100000:2.0:1787790864.414273:0:14427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790864.414383:0:14427:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b64ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787790864.414575:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253366528 00000100:00100000:1.0:1787790864.414585:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253366528 00000100:00100000:1.0:1787790864.414685:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787790864.414696:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8529acdd-b606-48f0-be71-c40064ed5481+3:14427:x1874634253366528:12345-0@lo:104: 00010000:00010000:1.0:1787790864.414709:0:14395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a82153a00/0x70647b5fa97753fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9775401 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790864.414828:0:14395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787790864.414836:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8529acdd-b606-48f0-be71-c40064ed5481+3:14427:x1874634253366528:12345-0@lo:104: Request processed in 141us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790864.414843:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787790864.414921:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790864.414935:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a82153a00/0x70647b5fa97753fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9775401 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790864.414942:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153a00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:2.0:1787790864.414946:0:14401:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a82153a00/0x70647b5fa97753fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa9775401 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790864.414956:0:14401:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a82153a00/0x70647b5fa97753fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa9775401 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790864.414963:0:14401:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a82153a00/0x70647b5fa97753fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa9775401 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790864.414980:0:14401:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787790864.415021:0:14401:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a82153a00/0x70647b5fa97753fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9775401 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790864.415029:0:14401:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790864.415055:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a82153a00/0x70647b5fa97753fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9775401 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790864.415062:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a82153a00/0x70647b5fa97753fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9775401 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790864.415082:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790864.415084:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790864.415086:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790864.415105:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8529acdd-b606-48f0-be71-c40064ed5481:3320:1874634253366656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790864.415142:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790864.415241:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253366656 00000100:00100000:3.0:1787790864.415252:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253366656 00010000:00010000:3.0:1787790864.416079:0:14398:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a67980e00/0x70647b5fa9775401 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97753fa expref: 20 pid: 14406 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790864.416122:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787790864.416131:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8529acdd-b606-48f0-be71-c40064ed5481+20:3320:x1874634253366656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787790864.416147:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790864.416154:0:14398:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a67980e00/0x70647b5fa9775401 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97753fa expref: 20 pid: 14406 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790864.416168:0:14398:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a67980e00/0x70647b5fa9775401 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa97753fa expref: 20 pid: 14406 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790864.416195:0:14398:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff931a4654f000/0x70647b5fa9775463 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790864.416205:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a4654f000/0x70647b5fa9775463 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787790864.416224:0:14398:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004831467s 00010000:00010000:3.0:1787790864.416229:0:14398:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a4654f000/0x70647b5fa9775463 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790864.416238:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a4654f000/0x70647b5fa9775463 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790864.416246:0:14398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff931a4654f000/0x70647b5fa9775463 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790864.416252:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff931a4654f000/0x70647b5fa9775463 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790864.417082:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a67980e00/0x70647b5fa9775401 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa97753fa expref: 20 pid: 14406 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790864.417096:0:14427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befe1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14427:1874634253366528:0@lo:104: 00010000:00010000:0.0:1787790864.417117:0:14427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff931a4654f000/0x70647b5fa9775463 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790864.417126:0:14427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff931a4654f000/0x70647b5fa9775463 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790864.417131:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff931a4654f000/0x70647b5fa9775463 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790864.417166:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f000 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790864.417172:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff931a4654f000/0x70647b5fa9775463 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790864.417181:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff931a4654f000/0x70647b5fa9775463 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790864.417191:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff931a4654f000/0x70647b5fa9775463 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790864.417199:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a4654f000/0x70647b5fa9775463 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790864.417211:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790864.417440:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8529acdd-b606-48f0-be71-c40064ed5481+19:3320:x1874634253366656:12345-0@lo:103:ldlm_bl.0 Request processed in 1308us (2295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790864.417450:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787790864.417538:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8529acdd-b606-48f0-be71-c40064ed5481:3320:1874634253366656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790864.421270:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+18:15808:x1874634253366400:12345-0@lo:253:mount.lustre.0 Request processed in 42106us (42203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790864.421304:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787790864.421409:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8529acdd-b606-48f0-be71-c40064ed5481:15808:1874634253366400:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787790864.421432:0:15808:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787790864.421436:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787790864.421439:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787790864.421440:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790864.421441:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790864.421443:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790864.421444:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790864.421445:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787790864.421448:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790864.421449:0:15808:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787790864.421467:0:15808:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787790864.425707:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787790864.425908:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787790864.426266:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787790864.426440:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787790864.426585:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787790864.427067:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787790864.427810:0:15808:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787790864.472288:0:15808:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787790864.472300:0:15808:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787790864.472350:0:15808:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787790864.472435:0:15808:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.125@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787790864.472457:0:15808:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787790864.472489:0:15808:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787790864.513536:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790865.407959:0:3317:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787790850/real 1787790850] req@ffff931a7be1b480 x1874634253359744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790865 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790865.407997:0:3317:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff931a7be1b480 x1874634253359744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790865 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790865.408007:0:3317:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787790850/real 1787790850] req@ffff931a7be18f00 x1874634253359488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790865 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790865.408018:0:3317:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff931a7be18f00 x1874634253359488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790865 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787790865.408039:0:3317:0:(import.c:65:import_set_state_nolock()) ffff931a48887800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787790865.408065:0:3317:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787790865.408079:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1874634253359744:0@lo:8:kworker.0 00000100:00080000:1.0:1787790865.408087:0:3317:0:(import.c:65:import_set_state_nolock()) ffff931a716af800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787790865.408092:0:3317:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787790865.408095:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1874634253359488:0@lo:8:kworker.0 00000100:00080000:2.0:1787790865.408212:0:13164:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790865.408217:0:13164:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787790865.408220:0:13164:0:(import.c:65:import_set_state_nolock()) ffff931a48887800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787790865.408225:0:13164:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 385 00000100:00080000:2.0:1787790865.408230:0:13164:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787790865.408236:0:13164:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff931a48887800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:2.0:1787790865.408256:0:13164:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931a7befde00 x1874634253366912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787790865.408280:0:13164:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790865.408283:0:13164:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787790865.408285:0:13164:0:(import.c:65:import_set_state_nolock()) ffff931a716af800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787790865.408289:0:13164:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 385 00000100:00080000:2.0:1787790865.408291:0:13164:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787790865.408295:0:13164:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff931a716af800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:2.0:1787790865.408306:0:13164:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931a7befed00 x1874634253367040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787790865.408355:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1874634253367424:0@lo:400:kworker.0 00000100:00100000:2.0:1787790865.408438:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790865.408486:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787790865.408493:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8529acdd-b606-48f0-be71-c40064ed5481:3320:1874634253366784:0@lo:400:kworker.0 00000100:00100000:2.0:1787790865.408520:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790865.408550:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253367168:0@lo:400:kworker.0 00000100:00100000:2.0:1787790865.408580:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790865.408597:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787790865.408602:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253367296:0@lo:400:kworker.0 00000100:00100000:2.0:1787790865.408620:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790865.408650:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253367424 00000100:00100000:2.0:1787790865.408658:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253367424 00000100:00100000:2.0:1787790865.408709:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253367168 00000100:00100000:2.0:1787790865.408712:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253367168 00000100:00100000:2.0:1787790865.408747:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253367296 00000100:00100000:2.0:1787790865.408750:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253367296 00000100:00100000:2.0:1787790865.408766:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787790865.408775:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874634253367424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790865.408826:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874634253367424:12345-0@lo:400:kworker.0 Request processed in 51us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790865.408833:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787790865.408848:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787790865.408854:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253367168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790865.408885:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253367168:12345-0@lo:400:kworker.0 Request processed in 31us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790865.408891:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787790865.408904:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787790865.408911:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253367296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790865.408937:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253367296:12345-0@lo:400:kworker.0 Request processed in 28us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790865.408943:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787790865.408961:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253366784 00000100:00100000:2.0:1787790865.408965:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253366784 00000100:00100000:2.0:1787790865.408997:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787790865.409002:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+18:3320:x1874634253366784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790865.409030:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+18:3320:x1874634253366784:12345-0@lo:400:kworker.0 Request processed in 28us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790865.409036:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1787790865.409065:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787790865.409098:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7befe580 x1874634253367296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790865.409111:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253367296:0@lo:400:kworker.0 00010000:00080000:2.0:1787790865.409120:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7beffc00 x1874634253367168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790865.409128:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253367168:0@lo:400:kworker.0 00000100:00100000:2.0:1787790865.409148:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1874634253366912:0@lo:8:kworker.0 00000100:00100000:2.0:1787790865.409178:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790865.409196:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1874634253367040:0@lo:8:kworker.0 00000100:00100000:2.0:1787790865.409216:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790865.409243:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8529acdd-b606-48f0-be71-c40064ed5481:3320:1874634253366784:0@lo:400:kworker.0 00010000:00080000:2.0:1787790865.409252:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7befc3c0 x1874634253367424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790865.409260:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1874634253367424:0@lo:400:kworker.0 00000100:00100000:1.0:1787790865.409649:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253366912 00000100:00100000:1.0:1787790865.409655:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253366912 00000100:00100000:1.0:1787790865.409671:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253367040 00000100:00100000:1.0:1787790865.409674:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253367040 00000100:00100000:1.0:1787790865.409686:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787790865.409691:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3317:x1874634253366912:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787790865.409719:0:15095:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 400 last 0 00000020:00000080:1.0:1787790865.409770:0:15095:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x70647b5fa977546a 00002000:00100000:1.0:1787790865.409791:0:15095:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff931a5ffcb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113932 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787790865.409796:0:15095:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787790865.409799:0:15095:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787790865.410196:0:15095:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787790865.410222:0:15095:0:(import.c:65:import_set_state_nolock()) ffff931a5ffcf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787790865.410468:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1874634253366912:12345-0@lo:8:kworker.0 Request processed in 774us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790865.410476:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787790865.410505:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787790865.410510:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3317:x1874634253367040:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787790865.410528:0:15095:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 400 last 0 00000020:00000080:1.0:1787790865.410546:0:15095:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x70647b5fa9775471 00002000:00100000:1.0:1787790865.410553:0:15095:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff931a5ffca800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113932 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787790865.410568:0:15095:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787790865.410571:0:15095:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787790865.410815:0:15095:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787790865.410828:0:15095:0:(import.c:65:import_set_state_nolock()) ffff931a5ffcb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787790865.410861:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1874634253367040:12345-0@lo:8:kworker.0 Request processed in 349us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790865.410868:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787790865.411197:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7befde00 x1874634253366912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787790885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790865.411208:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787790865.411223:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787790865.411230:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787790865.411235:0:3317:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787790865.411237:0:3317:0:(import.c:65:import_set_state_nolock()) ffff931a48887800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787790865.411265:0:3317:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787790865.411279:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1874634253366912:0@lo:8:kworker.0 00010000:00080000:2.0:1787790865.411295:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7befed00 x1874634253367040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787790885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790865.411302:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787790865.411306:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787790865.411310:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787790865.411313:0:3317:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787790865.411315:0:3317:0:(import.c:65:import_set_state_nolock()) ffff931a716af800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787790865.411331:0:3317:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787790865.411335:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1874634253367040:0@lo:8:kworker.0 00000004:00080000:3.0:1787790865.411525:0:14433:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787790865.411891:0:14433:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 400292166343ns, next at 0ns, rc = 0 00000004:00080000:1.0:1787790865.413600:0:14434:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1787790865.413630:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf11a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14434:1874634253367680:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787790865.413704:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790865.413756:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a455f9780 going to sleep for 11 seconds 00000004:00080000:1.0:1787790865.413793:0:14436:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787790865.413807:0:14436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf10780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14436:1874634253367936:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787790865.413832:0:14436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790865.414127:0:14436:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a455f9240 going to sleep for 11 seconds 00000100:00100000:3.0:1787790865.414859:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf12940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253367552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790865.414908:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787790865.415106:0:14435:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787790865.415641:0:14435:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 400295916145ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787790865.415850:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253367552 00000100:00100000:3.0:1787790865.415859:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253367552 00000100:00100000:3.0:1787790865.415933:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787790865.415955:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1874634253367552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790865.416000:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790865.416087:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1874634253367552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790865.416095:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787790865.416157:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7bf12940 x1874634253367552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790865.416182:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf12940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253367552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790865.416881:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253367680 00000100:00100000:1.0:1787790865.416889:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253367680 00000100:00100000:1.0:1787790865.416926:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253367936 00000100:00100000:1.0:1787790865.416930:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253367936 00000100:00100000:1.0:1787790865.416954:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787790865.416962:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf12d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14434:x1874634253367680:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787790865.421045:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787790865.421081:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253367808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790865.421165:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787790865.421919:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787790865.421927:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790865.425971:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253367808 00000100:00100000:3.0:1787790865.425992:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253367808 00000100:00100000:3.0:1787790865.426054:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790865.426064:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1874634253367808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787790865.426092:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790865.426190:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1874634253367808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (5025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790865.426197:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787790865.426246:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7bf11680 x1874634253367808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790865.426269:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253367808:0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1787790865.433344:0:15093:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787790865.433356:0:15093:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1787790865.433362:0:15093:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:1.0:1787790865.458637:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.458652:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775478 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.458682:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.458687:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.458695:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775478 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.458715:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775478 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.458820:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775478 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.458829:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775478 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.458852:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790865.458866:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790865.458874:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775478 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.458882:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705600 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790865.458893:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775478 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.458904:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775478 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.459243:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775478 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.459253:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775478 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.459275:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.459277:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.459279:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790865.469704:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.469720:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa977547f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.469762:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.469767:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.469774:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa977547f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.469787:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa977547f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.469798:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa977547f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.469806:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa977547f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.469842:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790865.469855:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790865.469861:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa977547f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.469869:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704000 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790865.469874:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa977547f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.469885:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa977547f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.469904:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa977547f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.469912:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa977547f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.469929:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.469931:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.469933:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790865.474971:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.474991:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775486 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.475012:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.475029:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.475037:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775486 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.475054:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775486 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.475065:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775486 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.475072:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775486 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.475093:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790865.475107:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790865.475114:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775486 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.475123:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705600 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790865.475129:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775486 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.475137:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775486 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.475158:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775486 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.475176:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa9775486 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.475194:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.475196:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.475198:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790865.477032:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.477047:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa977548d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.477066:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.477070:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.477076:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa977548d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.477090:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa977548d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.477100:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa977548d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.477106:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa977548d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.477128:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790865.477141:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790865.477157:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa977548d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.477165:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704a00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790865.477171:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa977548d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.477180:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa977548d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.477199:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa977548d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.477206:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa977548d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.477222:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.477224:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.477226:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790865.477703:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.477709:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa9775494 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.477718:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.477721:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.477759:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa9775494 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.477780:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa9775494 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.477788:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa9775494 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.477795:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa9775494 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.477825:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790865.477834:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790865.478267:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa9775494 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.478276:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704c00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790865.478279:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa9775494 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.478288:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa9775494 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.478303:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa9775494 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.478311:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa9775494 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.478336:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.478338:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.478340:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790865.479154:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.479166:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa977549b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.479181:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.479185:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.479192:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa977549b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.479203:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa977549b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.479212:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa977549b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.479220:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa977549b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.479240:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790865.479251:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790865.479256:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa977549b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.479276:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704e00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790865.479280:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa977549b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.479290:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa977549b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.479303:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa977549b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.479311:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa977549b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.479327:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.479328:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.479330:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790865.480755:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.480769:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa97754a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.480783:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.480788:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.480794:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa97754a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.480806:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa97754a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.480826:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa97754a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.480845:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa97754a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.480874:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787790865.481161:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790865.481169:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa97754a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.481177:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704000 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:2.0:1787790865.481182:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa97754a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.481200:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa97754a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.481219:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa97754a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.481226:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa97754a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.481243:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790865.481245:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790865.481247:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790865.481366:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.481373:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fadff524/0x70647b5fa97754a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.481396:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.481400:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.481405:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fadff524/0x70647b5fa97754a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.481415:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fadff524/0x70647b5fa97754a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.481424:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fadff524/0x70647b5fa97754a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.481431:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fadff524/0x70647b5fa97754a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.481460:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787790865.481490:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790865.481496:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fadff524/0x70647b5fa97754a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.481504:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704400 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:2.0:1787790865.481507:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fadff524/0x70647b5fa97754a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.481516:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fadff524/0x70647b5fa97754a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.481528:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fadff524/0x70647b5fa97754a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.481546:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fadff524/0x70647b5fa97754a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.481560:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790865.481562:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790865.481563:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790865.481915:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.481921:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008708e82a/0x70647b5fa97754b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.481930:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.481933:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.481937:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008708e82a/0x70647b5fa97754b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.481947:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008708e82a/0x70647b5fa97754b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.481956:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008708e82a/0x70647b5fa97754b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.481963:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008708e82a/0x70647b5fa97754b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.481980:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787790865.482373:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787790865.485672:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790865.485690:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008708e82a/0x70647b5fa97754b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.485704:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705a00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:2.0:1787790865.485710:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008708e82a/0x70647b5fa97754b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.485738:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008708e82a/0x70647b5fa97754b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.485764:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008708e82a/0x70647b5fa97754b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.485772:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008708e82a/0x70647b5fa97754b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.485798:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790865.485800:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790865.485802:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.487375:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa97754b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.487403:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.487416:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.487423:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa97754b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.487440:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa97754b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.487453:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa97754b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.487461:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa97754b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.494292:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790865.494345:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790865.494357:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa97754b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.494373:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705200 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790865.494795:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa97754b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.494812:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa97754b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.494844:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa97754b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.494880:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa97754b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.494909:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.494911:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.494913:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790865.495654:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.495665:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa97754be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.495696:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.495702:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.495709:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa97754be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.495750:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa97754be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.495761:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa97754be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.495769:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa97754be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.495790:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790865.495800:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790865.495810:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa97754be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.495818:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704e00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790865.495821:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa97754be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.495829:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa97754be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.495842:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa97754be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.495850:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa97754be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.495864:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.495867:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.495868:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787790865.496480:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787790865.496754:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.496762:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa97754c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.496774:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.496778:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.496783:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa97754c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.496807:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa97754c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.496815:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa97754c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.496823:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa97754c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.496836:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790865.496846:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790865.496852:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa97754c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.496860:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704c00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790865.496865:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa97754c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.496874:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa97754c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.496888:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa97754c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.496896:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa97754c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.496920:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.496923:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.496924:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790865.497397:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.497405:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa97754cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.497415:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.497418:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.497424:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa97754cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.497434:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa97754cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.497442:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa97754cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.497450:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa97754cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.497465:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790865.497473:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790865.497478:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa97754cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.497497:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704a00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790865.497501:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa97754cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.497509:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa97754cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.497522:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa97754cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.497529:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa97754cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.497543:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.497544:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.497546:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790865.497930:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.497937:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa97754d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.497947:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.497950:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.497954:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa97754d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.497963:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa97754d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.497978:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa97754d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.497986:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa97754d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.498000:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790865.498008:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790865.498012:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa97754d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.498018:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705600 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790865.498022:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa97754d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.498030:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa97754d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.498041:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa97754d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.498047:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa97754d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.498060:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.498066:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.498068:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790865.507626:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.507643:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa97754da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.507666:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.507745:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.507754:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa97754da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.507772:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa97754da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.507783:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa97754da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.507792:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa97754da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.507817:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787790865.507961:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790865.507969:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa97754da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.507978:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705200 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:0.0:1787790865.507983:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa97754da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.507993:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa97754da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.508015:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa97754da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.511073:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa97754da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.511124:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790865.511126:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790865.511129:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790865.512765:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.512779:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000347495ce/0x70647b5fa97754e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.512800:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.512804:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.512812:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000347495ce/0x70647b5fa97754e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.516584:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000347495ce/0x70647b5fa97754e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.516617:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000347495ce/0x70647b5fa97754e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.516626:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000347495ce/0x70647b5fa97754e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.516652:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790865.516671:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790865.516677:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000347495ce/0x70647b5fa97754e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.516685:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705c00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790865.516690:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000347495ce/0x70647b5fa97754e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.516701:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000347495ce/0x70647b5fa97754e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.516739:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000347495ce/0x70647b5fa97754e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.516748:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000347495ce/0x70647b5fa97754e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.516780:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.516782:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.516784:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790865.525609:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.525623:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa97754e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.525641:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.525646:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.525653:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa97754e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.525667:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa97754e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.525692:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa97754e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.525700:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa97754e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.525752:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787790865.526255:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.526262:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa97754ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.526285:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.526289:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.526295:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa97754ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.526305:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa97754ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.526314:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa97754ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.526322:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa97754ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.526341:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787790865.526358:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787790865.526365:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa97754e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.526373:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705600 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790865.526393:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa97754e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.526404:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa97754e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.526440:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa97754e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.526450:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002abbf725/0x70647b5fa97754e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.526469:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790865.526473:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa97754ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.526479:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704a00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790865.526482:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa97754ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.526490:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa97754ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.526499:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa97754ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.526507:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010baf200/0x70647b5fa97754ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.526517:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.526518:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.526526:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790865.527002:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.527010:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa97754f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.527020:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.527023:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.527028:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa97754f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.527037:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa97754f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.527045:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa97754f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.527052:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa97754f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.527066:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790865.527073:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790865.527076:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa97754f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.527082:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704c00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790865.527085:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa97754f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.527103:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa97754f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.527112:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa97754f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.527119:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000903d3b5a/0x70647b5fa97754f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.527132:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.527133:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.527135:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790865.527569:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.527575:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa97754fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.527584:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.527587:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.527591:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa97754fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.527600:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa97754fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.527607:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa97754fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.527625:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa97754fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.527639:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790865.527647:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790865.527651:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa97754fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.527657:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704e00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790865.527660:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa97754fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.527667:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa97754fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.527678:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa97754fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.527685:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a01c10/0x70647b5fa97754fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.527699:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.527700:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.527702:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790865.528103:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.528115:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072c585c6/0x70647b5fa9775504 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.528125:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.528128:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.528132:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072c585c6/0x70647b5fa9775504 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.528141:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072c585c6/0x70647b5fa9775504 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.528150:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072c585c6/0x70647b5fa9775504 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.528157:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072c585c6/0x70647b5fa9775504 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.528169:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790865.528176:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790865.528180:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072c585c6/0x70647b5fa9775504 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.528187:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705e00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790865.528190:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072c585c6/0x70647b5fa9775504 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.528198:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072c585c6/0x70647b5fa9775504 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.528214:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072c585c6/0x70647b5fa9775504 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.528221:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072c585c6/0x70647b5fa9775504 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.528234:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.528236:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.528237:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790865.533894:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.533911:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa977550b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.533932:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.533937:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.533945:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa977550b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.533960:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa977550b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.533972:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa977550b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.533981:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa977550b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.534018:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790865.534043:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790865.534049:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa977550b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.534057:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705200 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790865.534062:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa977550b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.534072:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa977550b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.534093:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa977550b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.534101:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ead7b79/0x70647b5fa977550b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.534124:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.534126:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.534128:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790865.534647:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.534657:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008708e82a/0x70647b5fa9775512 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.534666:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.534676:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.534682:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008708e82a/0x70647b5fa9775512 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.534692:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008708e82a/0x70647b5fa9775512 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.534701:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008708e82a/0x70647b5fa9775512 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.534709:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008708e82a/0x70647b5fa9775512 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.534761:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787790865.534773:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790865.534778:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008708e82a/0x70647b5fa9775512 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.534787:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705a00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.534796:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008708e82a/0x70647b5fa9775512 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.534804:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008708e82a/0x70647b5fa9775512 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.534818:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008708e82a/0x70647b5fa9775512 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.534826:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008708e82a/0x70647b5fa9775512 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.535018:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.535020:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.535022:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790865.535187:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.535193:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fadff524/0x70647b5fa9775519 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.535203:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.535206:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.535211:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fadff524/0x70647b5fa9775519 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.535220:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fadff524/0x70647b5fa9775519 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.535228:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fadff524/0x70647b5fa9775519 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.535240:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fadff524/0x70647b5fa9775519 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.539821:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787790865.547217:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790865.547235:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fadff524/0x70647b5fa9775519 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.547250:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704400 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.547255:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fadff524/0x70647b5fa9775519 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.547267:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fadff524/0x70647b5fa9775519 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.547295:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fadff524/0x70647b5fa9775519 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.547327:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fadff524/0x70647b5fa9775519 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.547356:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.547358:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.547361:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.547431:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790865.547642:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.547652:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000347495ce/0x70647b5fa9775520 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.547686:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.547691:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.547699:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000347495ce/0x70647b5fa9775520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.547714:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000347495ce/0x70647b5fa9775520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.547737:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000347495ce/0x70647b5fa9775520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.547744:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000347495ce/0x70647b5fa9775520 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.547759:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787790865.548595:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.548603:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa9775527 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.548620:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.548624:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.548629:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa9775527 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.548640:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa9775527 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.548650:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa9775527 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.548659:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa9775527 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.549242:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787790865.549255:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000347495ce/0x70647b5fa9775520 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.549267:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45705c00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:0.0:1787790865.549272:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000347495ce/0x70647b5fa9775520 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.549285:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000347495ce/0x70647b5fa9775520 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.549310:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000347495ce/0x70647b5fa9775520 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.549317:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000347495ce/0x70647b5fa9775520 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.549342:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790865.549346:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa9775527 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.549352:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704000 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:0.0:1787790865.549364:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa9775527 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.549373:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa9775527 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.549397:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa9775527 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.549406:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790865.549408:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790865.549409:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.550436:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787790865.550453:0:15093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007387854d/0x70647b5fa9775527 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787790865.551181:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.551190:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d35929e4/0x70647b5fa977552e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.551206:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.551210:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.551217:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d35929e4/0x70647b5fa977552e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.551243:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d35929e4/0x70647b5fa977552e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.551252:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d35929e4/0x70647b5fa977552e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.551259:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d35929e4/0x70647b5fa977552e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.551284:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787790865.551450:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790865.551460:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d35929e4/0x70647b5fa977552e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.551469:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f0800 already unused, calling callback (ffffffffc17e2420) 00002000:00080000:1.0:1787790865.551471:0:15093:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00010000:00010000:0.0:1787790865.551474:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d35929e4/0x70647b5fa977552e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.551485:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d35929e4/0x70647b5fa977552e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.551505:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d35929e4/0x70647b5fa977552e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.551513:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d35929e4/0x70647b5fa977552e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.551546:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.551550:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790865.551562:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790865.551566:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790865.551603:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf12d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14434:x1874634253367680:12345-0@lo:5:osp-pre-0-0.0 Request processed in 134636us (137893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790865.551615:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787790865.551683:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf11a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14434:1874634253367680:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787790865.551705:0:14434:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1787790865.551788:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf11a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14434:1874634253368064:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787790865.551825:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790865.551871:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a7d83a240 going to sleep for 11 seconds 00000100:00100000:0.0:1787790865.551917:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253368064 00000100:00100000:0.0:1787790865.551925:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253368064 00000100:00100000:0.0:1787790865.552540:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787790865.552714:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf12580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14436:x1874634253367936:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787790865.560148:0:15093:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787790865.560163:0:15093:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1787790865.560171:0:15093:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:1.0:1787790865.568929:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787790865.569370:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040820f7a/0x70647b5fa9775535 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.569410:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787790865.569416:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790865.569424:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040820f7a/0x70647b5fa9775535 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.569448:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040820f7a/0x70647b5fa9775535 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.569461:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040820f7a/0x70647b5fa9775535 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.569468:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040820f7a/0x70647b5fa9775535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.575494:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787790865.576074:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790865.576087:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040820f7a/0x70647b5fa9775535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.576103:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f0000 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.576110:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040820f7a/0x70647b5fa9775535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.576122:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040820f7a/0x70647b5fa9775535 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.576150:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040820f7a/0x70647b5fa9775535 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.576159:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040820f7a/0x70647b5fa9775535 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.576186:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.576195:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.576197:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787790865.576230:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.576240:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9691949/0x70647b5fa977553c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.576255:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.576260:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.576268:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9691949/0x70647b5fa977553c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.576283:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9691949/0x70647b5fa977553c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.576293:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9691949/0x70647b5fa977553c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.576300:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9691949/0x70647b5fa977553c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.576328:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787790865.576338:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790865.576342:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9691949/0x70647b5fa977553c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.576349:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980000 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:0.0:1787790865.576353:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9691949/0x70647b5fa977553c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.576361:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9691949/0x70647b5fa977553c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.576373:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9691949/0x70647b5fa977553c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.576394:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9691949/0x70647b5fa977553c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.576411:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790865.576414:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790865.576416:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787790865.577098:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.577108:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042942395/0x70647b5fa9775543 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.577119:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.577129:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.577134:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042942395/0x70647b5fa9775543 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.577145:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042942395/0x70647b5fa9775543 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.577153:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042942395/0x70647b5fa9775543 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.577160:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042942395/0x70647b5fa9775543 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.577175:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787790865.577244:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790865.577250:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042942395/0x70647b5fa9775543 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.577258:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981000 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.577263:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042942395/0x70647b5fa9775543 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.577272:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042942395/0x70647b5fa9775543 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.577290:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042942395/0x70647b5fa9775543 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.577299:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042942395/0x70647b5fa9775543 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.577320:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787790865.577618:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.577623:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ba3a3f7/0x70647b5fa977554a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.577633:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.577637:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.577641:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ba3a3f7/0x70647b5fa977554a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.577650:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ba3a3f7/0x70647b5fa977554a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.577659:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ba3a3f7/0x70647b5fa977554a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.577673:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ba3a3f7/0x70647b5fa977554a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.577698:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790865.577761:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790865.577769:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ba3a3f7/0x70647b5fa977554a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.577777:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981a00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790865.577781:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ba3a3f7/0x70647b5fa977554a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.577790:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ba3a3f7/0x70647b5fa977554a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.577815:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ba3a3f7/0x70647b5fa977554a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.577822:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ba3a3f7/0x70647b5fa977554a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.577828:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.577832:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.577838:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.577841:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.577843:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787790865.578134:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.578140:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dbe5aba/0x70647b5fa9775551 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.578148:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.578151:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.578155:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dbe5aba/0x70647b5fa9775551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.578164:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dbe5aba/0x70647b5fa9775551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.578171:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dbe5aba/0x70647b5fa9775551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.578178:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dbe5aba/0x70647b5fa9775551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.578201:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787790865.581126:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790865.581148:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dbe5aba/0x70647b5fa9775551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.581165:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980e00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.581171:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dbe5aba/0x70647b5fa9775551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.581192:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dbe5aba/0x70647b5fa9775551 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.581214:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dbe5aba/0x70647b5fa9775551 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.581242:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dbe5aba/0x70647b5fa9775551 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787790865.583424:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.583440:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0b8b109/0x70647b5fa9775558 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.583466:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.583471:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.583478:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b8b109/0x70647b5fa9775558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.583494:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0b8b109/0x70647b5fa9775558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.583504:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0b8b109/0x70647b5fa9775558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.583513:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b8b109/0x70647b5fa9775558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.583537:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787790865.584056:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.584063:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6cfc8fe/0x70647b5fa977555f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.584072:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.584075:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.584079:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6cfc8fe/0x70647b5fa977555f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.584089:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6cfc8fe/0x70647b5fa977555f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.584108:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6cfc8fe/0x70647b5fa977555f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.584114:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6cfc8fe/0x70647b5fa977555f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.584124:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787790865.584596:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.584603:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021a0d487/0x70647b5fa9775566 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.584613:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.584616:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.584620:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021a0d487/0x70647b5fa9775566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.584630:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021a0d487/0x70647b5fa9775566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.584638:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021a0d487/0x70647b5fa9775566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.584646:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021a0d487/0x70647b5fa9775566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.584666:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787790865.585112:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.585118:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005518f130/0x70647b5fa977556d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.585128:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.585131:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.585136:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005518f130/0x70647b5fa977556d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.585146:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005518f130/0x70647b5fa977556d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.585154:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005518f130/0x70647b5fa977556d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.585160:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005518f130/0x70647b5fa977556d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.585169:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1787790865.585586:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.585592:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052d52779/0x70647b5fa9775574 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.585601:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.585609:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.585614:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052d52779/0x70647b5fa9775574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.585623:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052d52779/0x70647b5fa9775574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.585632:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052d52779/0x70647b5fa9775574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.585640:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052d52779/0x70647b5fa9775574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.585649:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1787790865.586102:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787790865.586112:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0b8b109/0x70647b5fa9775558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787790865.586116:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787790865.586127:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981800 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:0.0:1787790865.586128:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002198c715/0x70647b5fa977557b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586135:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b8b109/0x70647b5fa9775558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.586139:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.586145:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.586153:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002198c715/0x70647b5fa977557b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586155:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b8b109/0x70647b5fa9775558 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.586172:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002198c715/0x70647b5fa977557b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.586181:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002198c715/0x70647b5fa977557b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586183:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0b8b109/0x70647b5fa9775558 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586205:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0b8b109/0x70647b5fa9775558 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.586207:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002198c715/0x70647b5fa977557b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.586223:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1787790865.586252:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787790865.586257:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6cfc8fe/0x70647b5fa977555f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586263:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981400 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.586267:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6cfc8fe/0x70647b5fa977555f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586274:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6cfc8fe/0x70647b5fa977555f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586284:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6cfc8fe/0x70647b5fa977555f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586291:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6cfc8fe/0x70647b5fa977555f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586308:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787790865.586312:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021a0d487/0x70647b5fa9775566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586318:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981600 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.586322:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021a0d487/0x70647b5fa9775566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586342:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021a0d487/0x70647b5fa9775566 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586354:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021a0d487/0x70647b5fa9775566 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586362:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021a0d487/0x70647b5fa9775566 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586385:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787790865.586389:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005518f130/0x70647b5fa977556d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586395:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41478a00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.586399:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005518f130/0x70647b5fa977556d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586405:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005518f130/0x70647b5fa977556d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586414:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005518f130/0x70647b5fa977556d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586420:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005518f130/0x70647b5fa977556d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586445:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787790865.586449:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052d52779/0x70647b5fa9775574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586455:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479000 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.586458:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052d52779/0x70647b5fa9775574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586466:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052d52779/0x70647b5fa9775574 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586476:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052d52779/0x70647b5fa9775574 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586483:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052d52779/0x70647b5fa9775574 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586494:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790865.586497:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002198c715/0x70647b5fa977557b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586504:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479400 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.586507:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002198c715/0x70647b5fa977557b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586526:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002198c715/0x70647b5fa977557b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586537:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002198c715/0x70647b5fa977557b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586544:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002198c715/0x70647b5fa977557b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.586753:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.586756:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.586758:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.587586:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787790865.589862:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1787790865.592441:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.592457:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f35da0c/0x70647b5fa9775582 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.593439:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.593450:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.593461:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f35da0c/0x70647b5fa9775582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.593488:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f35da0c/0x70647b5fa9775582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.593502:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f35da0c/0x70647b5fa9775582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.593511:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f35da0c/0x70647b5fa9775582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.593542:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787790865.593555:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790865.593566:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f35da0c/0x70647b5fa9775582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.593577:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479800 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.593583:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f35da0c/0x70647b5fa9775582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.593593:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f35da0c/0x70647b5fa9775582 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.593614:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f35da0c/0x70647b5fa9775582 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.593635:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f35da0c/0x70647b5fa9775582 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.593657:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.593659:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.593661:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787790865.594360:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.594368:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001049328a/0x70647b5fa9775589 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.594394:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.594397:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.594403:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001049328a/0x70647b5fa9775589 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.594413:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001049328a/0x70647b5fa9775589 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.594422:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001049328a/0x70647b5fa9775589 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.594430:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001049328a/0x70647b5fa9775589 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.594448:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790865.595130:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790865.595139:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001049328a/0x70647b5fa9775589 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.595150:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41478e00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790865.595155:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001049328a/0x70647b5fa9775589 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.595164:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001049328a/0x70647b5fa9775589 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.595180:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001049328a/0x70647b5fa9775589 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.595187:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001049328a/0x70647b5fa9775589 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.595212:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.595214:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.595216:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787790865.595993:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.596001:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000419b195a/0x70647b5fa9775590 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.596015:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.596019:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.596025:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000419b195a/0x70647b5fa9775590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.596036:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000419b195a/0x70647b5fa9775590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.596057:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000419b195a/0x70647b5fa9775590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.596064:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000419b195a/0x70647b5fa9775590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.596077:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787790865.596928:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790865.597004:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000419b195a/0x70647b5fa9775590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.597017:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41478800 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.597022:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000419b195a/0x70647b5fa9775590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787790865.597025:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.597036:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000655fff30/0x70647b5fa9775597 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.597038:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000419b195a/0x70647b5fa9775590 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.597058:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.597063:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790865.597069:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000419b195a/0x70647b5fa9775590 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.597070:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000655fff30/0x70647b5fa9775597 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.597093:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000419b195a/0x70647b5fa9775590 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.597096:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000655fff30/0x70647b5fa9775597 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.597111:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000655fff30/0x70647b5fa9775597 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.597119:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000655fff30/0x70647b5fa9775597 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.597121:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.597125:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.597128:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790865.597158:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787790865.597923:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.597932:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003972b842/0x70647b5fa977559e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.597942:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.597945:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.597950:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003972b842/0x70647b5fa977559e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.597959:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003972b842/0x70647b5fa977559e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.597966:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003972b842/0x70647b5fa977559e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.597973:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003972b842/0x70647b5fa977559e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.597994:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787790865.598046:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787790865.598054:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000655fff30/0x70647b5fa9775597 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.598063:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479e00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.598068:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000655fff30/0x70647b5fa9775597 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.598077:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000655fff30/0x70647b5fa9775597 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.598092:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000655fff30/0x70647b5fa9775597 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.598100:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000655fff30/0x70647b5fa9775597 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.598122:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790865.598125:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003972b842/0x70647b5fa977559e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.598132:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a41479200 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.598135:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003972b842/0x70647b5fa977559e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.598142:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003972b842/0x70647b5fa977559e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.598170:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003972b842/0x70647b5fa977559e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.598178:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003972b842/0x70647b5fa977559e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.598197:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.598200:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.598202:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787790865.598466:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.598472:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000988ece3d/0x70647b5fa97755a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.599151:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.599167:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.599175:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000988ece3d/0x70647b5fa97755a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.599188:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000988ece3d/0x70647b5fa97755a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.599198:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000988ece3d/0x70647b5fa97755a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.599206:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000988ece3d/0x70647b5fa97755a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.599231:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787790865.599431:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790865.599440:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000988ece3d/0x70647b5fa97755a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.599450:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030000 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.599455:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000988ece3d/0x70647b5fa97755a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.599465:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000988ece3d/0x70647b5fa97755a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.599483:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000988ece3d/0x70647b5fa97755a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.599490:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000988ece3d/0x70647b5fa97755a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.599526:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.599529:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.599531:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.599605:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787790865.600130:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.600138:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004371f2e2/0x70647b5fa97755ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.600149:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.600153:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.600159:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004371f2e2/0x70647b5fa97755ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.600170:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004371f2e2/0x70647b5fa97755ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.600179:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004371f2e2/0x70647b5fa97755ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.600194:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004371f2e2/0x70647b5fa97755ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.600217:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787790865.600412:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790865.600419:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004371f2e2/0x70647b5fa97755ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.600428:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40031000 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.600432:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004371f2e2/0x70647b5fa97755ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.600442:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004371f2e2/0x70647b5fa97755ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.600458:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004371f2e2/0x70647b5fa97755ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.600466:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004371f2e2/0x70647b5fa97755ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.600483:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.600484:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.600486:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787790865.601042:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.601050:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eeaaeb3/0x70647b5fa97755b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.601062:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.601066:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.601071:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eeaaeb3/0x70647b5fa97755b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.601081:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eeaaeb3/0x70647b5fa97755b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.601090:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eeaaeb3/0x70647b5fa97755b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.601098:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006eeaaeb3/0x70647b5fa97755b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.601122:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787790865.601147:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790865.601155:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006eeaaeb3/0x70647b5fa97755b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.601165:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030e00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:2.0:1787790865.601169:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006eeaaeb3/0x70647b5fa97755b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.601178:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006eeaaeb3/0x70647b5fa97755b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.601196:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006eeaaeb3/0x70647b5fa97755b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.601203:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eeaaeb3/0x70647b5fa97755b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.601223:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790865.601225:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790865.601227:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787790865.601551:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.601556:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e2a94f4/0x70647b5fa97755ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.601571:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.601574:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.601577:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e2a94f4/0x70647b5fa97755ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.601586:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e2a94f4/0x70647b5fa97755ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.601594:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e2a94f4/0x70647b5fa97755ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.601600:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e2a94f4/0x70647b5fa97755ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.601835:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787790865.602075:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790865.602083:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e2a94f4/0x70647b5fa97755ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.602103:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030400 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.602107:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e2a94f4/0x70647b5fa97755ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.602116:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e2a94f4/0x70647b5fa97755ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.602130:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e2a94f4/0x70647b5fa97755ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.602137:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e2a94f4/0x70647b5fa97755ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.602158:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.602161:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.602164:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787790865.602256:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.602262:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027a654e7/0x70647b5fa97755c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.602270:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.602274:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.602279:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027a654e7/0x70647b5fa97755c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.602287:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027a654e7/0x70647b5fa97755c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.602305:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027a654e7/0x70647b5fa97755c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.602628:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027a654e7/0x70647b5fa97755c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.602898:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790865.602906:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027a654e7/0x70647b5fa97755c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.602915:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030200 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:0.0:1787790865.602917:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787790865.602919:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027a654e7/0x70647b5fa97755c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.602941:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027a654e7/0x70647b5fa97755c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.602955:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027a654e7/0x70647b5fa97755c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.602963:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027a654e7/0x70647b5fa97755c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.602982:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790865.602984:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790865.602986:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787790865.603455:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.603462:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079aa5aa2/0x70647b5fa97755c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.603473:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.603476:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.603482:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079aa5aa2/0x70647b5fa97755c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.603494:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079aa5aa2/0x70647b5fa97755c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.603503:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079aa5aa2/0x70647b5fa97755c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.603511:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079aa5aa2/0x70647b5fa97755c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.603550:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787790865.604208:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.604214:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb6364d7/0x70647b5fa97755cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.604224:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.604227:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.604232:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6364d7/0x70647b5fa97755cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.604241:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6364d7/0x70647b5fa97755cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.604248:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb6364d7/0x70647b5fa97755cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.604256:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6364d7/0x70647b5fa97755cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.605922:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787790865.606564:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.606574:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001afbfbf9/0x70647b5fa97755d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.606593:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.606616:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.606626:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001afbfbf9/0x70647b5fa97755d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.607207:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787790865.607219:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079aa5aa2/0x70647b5fa97755c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.607230:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40031a00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.607235:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079aa5aa2/0x70647b5fa97755c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.607247:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079aa5aa2/0x70647b5fa97755c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.607282:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079aa5aa2/0x70647b5fa97755c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.607291:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079aa5aa2/0x70647b5fa97755c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.607325:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790865.607329:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb6364d7/0x70647b5fa97755cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.607336:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40031c00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.607340:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb6364d7/0x70647b5fa97755cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.607348:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb6364d7/0x70647b5fa97755cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.607358:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb6364d7/0x70647b5fa97755cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.607365:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6364d7/0x70647b5fa97755cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.607390:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.607392:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.607399:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790865.608080:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001afbfbf9/0x70647b5fa97755d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.608106:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001afbfbf9/0x70647b5fa97755d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.608114:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001afbfbf9/0x70647b5fa97755d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.608146:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787790865.608411:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790865.608418:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001afbfbf9/0x70647b5fa97755d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.608428:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030600 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.608433:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001afbfbf9/0x70647b5fa97755d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.608435:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.608442:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001afbfbf9/0x70647b5fa97755d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.608458:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001afbfbf9/0x70647b5fa97755d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.608465:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001afbfbf9/0x70647b5fa97755d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.608483:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.608485:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.608486:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787790865.609249:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.609258:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000973499be/0x70647b5fa97755dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.609273:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.609278:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.609285:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000973499be/0x70647b5fa97755dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.609300:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000973499be/0x70647b5fa97755dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.609308:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000973499be/0x70647b5fa97755dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.609323:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000973499be/0x70647b5fa97755dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.609350:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787790865.609416:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790865.609423:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000973499be/0x70647b5fa97755dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.609432:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40031600 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:2.0:1787790865.609437:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000973499be/0x70647b5fa97755dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.609445:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000973499be/0x70647b5fa97755dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.609462:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000973499be/0x70647b5fa97755dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.609482:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000973499be/0x70647b5fa97755dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.609504:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790865.609506:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790865.609508:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787790865.609878:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.609884:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cdfd6bd/0x70647b5fa97755e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.609893:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.609896:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.609899:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cdfd6bd/0x70647b5fa97755e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.609908:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cdfd6bd/0x70647b5fa97755e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.609915:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cdfd6bd/0x70647b5fa97755e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.609921:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cdfd6bd/0x70647b5fa97755e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.609946:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787790865.609966:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790865.609975:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cdfd6bd/0x70647b5fa97755e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.609984:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030a00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.609988:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cdfd6bd/0x70647b5fa97755e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.610010:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cdfd6bd/0x70647b5fa97755e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.610024:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cdfd6bd/0x70647b5fa97755e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.610031:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cdfd6bd/0x70647b5fa97755e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.610048:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.610051:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.610054:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787790865.610307:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.610313:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4be1378/0x70647b5fa97755eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.610325:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.610328:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.610332:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4be1378/0x70647b5fa97755eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.610341:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4be1378/0x70647b5fa97755eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.610349:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4be1378/0x70647b5fa97755eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.610356:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4be1378/0x70647b5fa97755eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.610387:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787790865.610404:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790865.610412:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4be1378/0x70647b5fa97755eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.610420:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40031400 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:2.0:1787790865.610425:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4be1378/0x70647b5fa97755eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.610434:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4be1378/0x70647b5fa97755eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.610448:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4be1378/0x70647b5fa97755eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.610456:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4be1378/0x70647b5fa97755eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.610473:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790865.610476:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790865.610478:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787790865.610828:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787790865.610834:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9691949/0x70647b5fa97755f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.610842:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787790865.610845:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790865.610848:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9691949/0x70647b5fa97755f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.610857:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9691949/0x70647b5fa97755f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.610876:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9691949/0x70647b5fa97755f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.610884:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9691949/0x70647b5fa97755f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.610913:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787790865.610941:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790865.610948:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9691949/0x70647b5fa97755f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.610956:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980000 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790865.610961:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9691949/0x70647b5fa97755f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.610971:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9691949/0x70647b5fa97755f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.610984:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9691949/0x70647b5fa97755f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.611004:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9691949/0x70647b5fa97755f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790865.611024:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.611026:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790865.611029:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787790865.611095:0:15093:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1787790865.611248:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf12580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14436:x1874634253367936:12345-0@lo:5:osp-pre-1-0.0 Request processed in 58690us (197410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790865.611261:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787790865.611316:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787790865.611331:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf10b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14434:x1874634253368064:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787790865.611395:0:15093:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1787790865.611446:0:14436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf10780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14436:1874634253367936:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787790865.611462:0:14436:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1787790865.611505:0:14436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befde00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14436:1874634253368192:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787790865.611551:0:14436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790865.611604:0:14436:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4b64ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790865.611919:0:15096:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787790865.611928:0:15096:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787790865.613445:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253368192 00000100:00100000:2.0:1787790865.613460:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253368192 00000100:00100000:3.0:1787790865.613607:0:15889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787790865.613621:0:15889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14436:x1874634253368192:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787790865.614040:0:15889:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1787790865.627140:0:15889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14436:x1874634253368192:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13515us (15581us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787790865.627154:0:15889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787790865.629073:0:14436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befde00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14436:1874634253368192:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787790865.629100:0:14436:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1787790865.630571:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf10b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14434:x1874634253368064:12345-0@lo:5:osp-pre-0-0.0 Request processed in 19239us (78737us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787790865.630586:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787790865.630617:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf11a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14434:1874634253368064:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787790865.630636:0:14434:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 10000000:01000000:0.0:1787790866.241196:0:14409:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787790866.241204:0:14409:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff931a4b638800 from 8 10000000:01000000:0.0:1787790866.241209:0:14409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787790866.241266:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a67981000/0x70647b5fa97755f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790866.241279:0:14409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a67981000/0x70647b5fa97755f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790866.241308:0:14409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a67981000/0x70647b5fa97755f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790866.241335:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253368320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787790866.241424:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790866.241469:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a42f91600 going to sleep for 11 seconds 00000100:00100000:3.0:1787790866.241951:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253368320 00000100:00100000:3.0:1787790866.241960:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253368320 00000100:00100000:3.0:1787790866.242013:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787790866.242022:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+18:14409:x1874634253368320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790866.242035:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790866.242050:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a82152000/0x70647b5fa9775600 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97755f9 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790866.242076:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a82152000/0x70647b5fa9775600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97755f9 expref: 19 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790866.242088:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a82152000/0x70647b5fa9775600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97755f9 expref: 19 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790866.242111:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82152000, rc 0) 00000100:00100000:3.0:1787790866.242160:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+19:14409:x1874634253368320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790866.242166:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787790866.242220:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253368320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790866.242237:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a67981000/0x70647b5fa97755f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775600 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790866.242248:0:14409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a67981000/0x70647b5fa97755f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa9775600 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790866.242302:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253368448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787790866.242337:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790866.242358:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4cbb2600 going to sleep for 11 seconds 00000100:00100000:2.0:1787790866.242428:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253368448 00000100:00100000:2.0:1787790866.242434:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253368448 00000100:00100000:2.0:1787790866.242462:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787790866.242470:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4568f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+19:14409:x1874634253368448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787790866.242484:0:14407:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787790866.242505:0:14407:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787790866.242508:0:14407:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787790866.242596:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4568f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+19:14409:x1874634253368448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790866.242602:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787790866.242635:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253368448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787790866.242710:0:14409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787790866.242717:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a67981000/0x70647b5fa97755f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775600 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790866.242747:0:14409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a67981000/0x70647b5fa97755f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa9775600 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790866.560175:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790867.584321:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787790867.651186:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1787790867.651274:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787790868.610409:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790869.638574:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787790869.693264:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787790869.693290:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:3.0:1787790870.593989:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253368576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790870.594109:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790870.594213:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253368576 00000100:00100000:3.0:1787790870.594223:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253368576 00000100:00100000:3.0:1787790870.594312:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787790870.594323:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253368576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790870.594372:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790870.594642:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874634253368576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 321us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790870.594653:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787790870.594693:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf10f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253368704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790870.594750:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790870.594787:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253368704 00000100:00100000:3.0:1787790870.594791:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253368704 00000100:00100000:3.0:1787790870.594814:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787790870.594820:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253368704:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790870.594965:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787790870.594997:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1874634253368576:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790870.595033:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787790870.595264:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787790870.595270:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790870.595344:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253368704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 523us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790870.595352:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787790870.602104:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8529acdd-b606-48f0-be71-c40064ed5481:3321:1874634253368832:0@lo:400:kworker.0 00000100:00100000:2.0:1787790870.602237:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790870.602327:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787790870.602333:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7beff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1874634253369216:0@lo:400:kworker.0 00000100:00100000:2.0:1787790870.602366:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790870.602544:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253368960:0@lo:400:kworker.0 00000100:00100000:0.0:1787790870.602583:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790870.602607:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787790870.602613:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7befda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253369088:0@lo:400:kworker.0 00000100:00100000:0.0:1787790870.602636:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790870.602801:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253368832 00000100:00100000:2.0:1787790870.602812:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253368832 00000100:00100000:2.0:1787790870.603498:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787790870.603512:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+19:3321:x1874634253368832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790870.603602:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+19:3321:x1874634253368832:12345-0@lo:400:kworker.0 Request processed in 93us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790870.603612:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787790870.603664:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253369216 00000100:00100000:2.0:1787790870.603669:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253369216 00000100:00100000:2.0:1787790870.603711:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253368960 00000100:00100000:2.0:1787790870.603715:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253368960 00000100:00100000:2.0:1787790870.603760:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253369088 00000100:00100000:2.0:1787790870.603763:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253369088 00000100:00100000:2.0:1787790870.603779:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787790870.603786:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874634253369216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790870.603823:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874634253369216:12345-0@lo:400:kworker.0 Request processed in 38us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790870.603841:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787790870.603997:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787790870.604005:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253368960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790870.604320:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253368960:12345-0@lo:400:kworker.0 Request processed in 315us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790870.604327:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787790870.604341:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787790870.604348:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253369088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790870.604378:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253369088:12345-0@lo:400:kworker.0 Request processed in 30us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790870.604395:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787790870.604450:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7beff840 x1874634253369216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790870.604469:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1874634253369216:0@lo:400:kworker.0 00000100:00100000:2.0:1787790870.604481:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7beff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8529acdd-b606-48f0-be71-c40064ed5481:3321:1874634253368832:0@lo:400:kworker.0 00000100:00080000:2.0:1787790870.604510:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790870.605524:0:3320:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787790870.605561:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf10f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253368704:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787790870.607615:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7befe940 x1874634253368960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790870.607636:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253368960:0@lo:400:kworker.0 00010000:00080000:0.0:1787790870.607667:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931a7befda40 x1874634253369088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790870.607676:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7befda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253369088:0@lo:400:kworker.0 00000001:02000400:1.0:1787790870.612220:0:16167:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787790870.657124:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790871.681355:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790872.674934:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790872.675242:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236599040 00000100:00100000:3.0:1787790872.675372:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236599040 00000100:00100000:3.0:1787790872.675426:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 76 00000100:00100000:3.0:1787790872.675438:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2345:x1874634236599040:12345-192.168.201.25@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787790872.675472:0:14405:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4@192.168.201.25@tcp t0 exp 0000000000000000 cur 407 last 0 00000020:00000080:3.0:1787790872.675512:0:14405:0:(genops.c:1385:class_connect()) connect: client 0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4, cookie 0x70647b5fa9775607 00000100:00080000:3.0:1787790872.676142:0:14405:0:(import.c:65:import_set_state_nolock()) ffff9319446e7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790872.676264:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+5:2345:x1874634236599040:12345-192.168.201.25@tcp:250:mount.lustre.0 Request processed in 816us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790872.676272:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 76 00000100:00100000:3.0:1787790872.683126:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790872.683247:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236599168 00000100:00100000:0.0:1787790872.683387:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236599168 00000100:00100000:0.0:1787790872.683501:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 77 00000100:00100000:0.0:1787790872.683514:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+5:13751:x1874634236599168:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787790872.683547:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790872.683570:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a67980000/0x70647b5fa977560e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496ee18 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790872.683640:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a67980000/0x70647b5fa977560e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee18 expref: 6 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790872.683652:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a67980000/0x70647b5fa977560e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee18 expref: 6 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790872.683662:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67980000, rc 0) 00000100:00100000:0.0:1787790872.683758:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+6:13751:x1874634236599168:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 247us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790872.683766:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 77 00000100:00100000:2.0:1787790872.690574:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790872.690718:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236599296 00000100:00100000:3.0:1787790872.691394:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236599296 00000100:00100000:0.0:1787790872.691987:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00100000:0.0:1787790872.692003:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+6:13751:x1874634236599296:12345-192.168.201.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787790872.693266:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+6:13751:x1874634236599296:12345-192.168.201.25@tcp:501:mount.lustre.0 Request processed in 1246us (2681us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787790872.693280:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00100000:1.0:1787790872.696454:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790872.696560:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236599424 00000100:00100000:2.0:1787790872.696574:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236599424 00000100:00100000:2.0:1787790872.697049:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:2.0:1787790872.697070:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+6:13751:x1874634236599424:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787790872.697088:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790872.697110:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a4654ea00/0x70647b5fa9775615 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496ee1f expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790872.697161:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a4654ea00/0x70647b5fa9775615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee1f expref: 7 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790872.697174:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a4654ea00/0x70647b5fa9775615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee1f expref: 7 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790872.697184:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654ea00, rc 0) 00000100:00100000:2.0:1787790872.697369:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+7:13751:x1874634236599424:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 301us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790872.697378:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 79 00010000:00010000:1.0:1787790872.704345:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790872.713808:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790872.714370:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236599552 00000100:00100000:0.0:1787790872.714382:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236599552 00000100:00100000:0.0:1787790872.714449:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 80 00000100:00100000:0.0:1787790872.714459:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+7:13751:x1874634236599552:12345-192.168.201.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787790872.715263:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+8:13751:x1874634236599552:12345-192.168.201.25@tcp:501:mount.lustre.0 Request processed in 791us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790872.715273:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 80 00000100:00100000:3.0:1787790872.718924:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790872.719355:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236599680 00000100:00100000:2.0:1787790872.719367:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236599680 00000100:00100000:2.0:1787790872.719429:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 81 00000100:00100000:2.0:1787790872.719437:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+8:13751:x1874634236599680:12345-192.168.201.25@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787790872.719902:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+8:13751:x1874634236599680:12345-192.168.201.25@tcp:503:mount.lustre.0 Request processed in 464us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790872.719910:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 81 00000100:00100000:2.0:1787790872.733717:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790872.734045:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236599808 00000100:00100000:1.0:1787790872.734055:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236599808 00000100:00100000:1.0:1787790872.734112:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 82 00000100:00100000:1.0:1787790872.734122:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+8:13769:x1874634236599808:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787790872.734501:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+8:13769:x1874634236599808:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 379us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790872.734510:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 82 00000100:00100000:2.0:1787790872.753632:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790872.753708:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236599936 00000100:00100000:0.0:1787790872.753719:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236599936 00000100:00100000:0.0:1787790872.754040:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 83 00000100:00100000:0.0:1787790872.754063:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+8:13769:x1874634236599936:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787790872.754376:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+8:13769:x1874634236599936:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 316us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790872.754384:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 83 00000100:00100000:3.0:1787790872.757480:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790872.758921:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236600064 00000100:00100000:2.0:1787790872.758934:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236600064 00000100:00100000:2.0:1787790872.759007:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 84 00000100:00100000:2.0:1787790872.759020:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+8:13751:x1874634236600064:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787790872.759043:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790872.759066:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a4654e600/0x70647b5fa977561c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496ee49 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790872.759111:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a4654e600/0x70647b5fa977561c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee49 expref: 9 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790872.759119:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a4654e600/0x70647b5fa977561c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee49 expref: 9 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790872.759128:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654e600, rc 0) 00000100:00100000:2.0:1787790872.759182:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+9:13751:x1874634236600064:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 168us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790872.759187:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 84 00000100:00100000:2.0:1787790872.769601:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790872.771745:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236600192 00000100:00100000:1.0:1787790872.771761:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236600192 00000100:00100000:1.0:1787790872.772070:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 85 00000100:00100000:1.0:1787790872.772083:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+9:13751:x1874634236600192:12345-192.168.201.25@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787790872.772129:0:14407:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787790872.772163:0:14407:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787790872.772168:0:14407:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787790872.772172:0:14407:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787790872.772174:0:14407:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787790872.778858:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+9:13751:x1874634236600192:12345-192.168.201.25@tcp:256:mount.lustre.0 Request processed in 6754us (9244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790872.778881:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 85 00000100:00100000:2.0:1787790872.783984:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790872.784183:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236600320 00000100:00100000:1.0:1787790872.784197:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236600320 00000100:00100000:1.0:1787790872.784309:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 86 00000100:00100000:1.0:1787790872.784331:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+9:13751:x1874634236600320:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787790872.784354:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790872.784379:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a542f0000/0x70647b5fa9775623 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496ee50 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790872.784416:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a542f0000/0x70647b5fa9775623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee50 expref: 10 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790872.784428:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a542f0000/0x70647b5fa9775623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee50 expref: 10 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790872.784440:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f0000, rc 0) 00000100:00100000:1.0:1787790872.784549:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+10:13751:x1874634236600320:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 231us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790872.784557:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 86 00000100:00100000:2.0:1787790872.787272:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790872.787485:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236600448 00000100:00100000:0.0:1787790872.787496:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236600448 00000100:00100000:0.0:1787790872.787558:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 87 00000100:00100000:0.0:1787790872.787570:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+10:13751:x1874634236600448:12345-192.168.201.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787790872.788395:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+10:13751:x1874634236600448:12345-192.168.201.25@tcp:501:mount.lustre.0 Request processed in 824us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790872.788406:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 87 00000100:00100000:2.0:1787790872.790583:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790872.790663:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236600576 00000100:00100000:1.0:1787790872.790689:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236600576 00000100:00100000:1.0:1787790872.791180:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 88 00000100:00100000:1.0:1787790872.791192:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+10:13751:x1874634236600576:12345-192.168.201.25@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787790872.791678:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+10:13751:x1874634236600576:12345-192.168.201.25@tcp:503:mount.lustre.0 Request processed in 487us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790872.791687:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 88 00000100:00100000:2.0:1787790872.797426:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790872.797547:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236600704 00000100:00100000:0.0:1787790872.797557:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236600704 00000100:00100000:0.0:1787790872.797624:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 89 00000100:00100000:0.0:1787790872.797634:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+10:13774:x1874634236600704:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787790872.798003:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+10:13774:x1874634236600704:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 369us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790872.798011:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 89 00000100:00100000:2.0:1787790872.803472:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790872.803586:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236600832 00000100:00100000:1.0:1787790872.803602:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236600832 00000100:00100000:1.0:1787790872.803678:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 90 00000100:00100000:1.0:1787790872.803690:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+10:13774:x1874634236600832:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787790872.804201:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+10:13774:x1874634236600832:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 512us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790872.804219:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 90 00000100:00100000:2.0:1787790872.818804:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790872.819447:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236600960 00000100:00100000:0.0:1787790872.819466:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236600960 00000100:00100000:0.0:1787790872.819538:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:0.0:1787790872.819550:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2345:x1874634236600960:12345-192.168.201.25@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787790872.819616:0:14411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6@192.168.201.25@tcp t0 exp 0000000000000000 cur 407 last 0 00000020:00000080:0.0:1787790872.819705:0:14411:0:(genops.c:1385:class_connect()) connect: client a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6, cookie 0x70647b5fa977562a 00000004:00100000:0.0:1787790872.819802:0:14411:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787790872.819812:0:14411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787790872.858328:0:14411:0:(import.c:65:import_set_state_nolock()) ffff931a7d976800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787790872.858523:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+6:2345:x1874634236600960:12345-192.168.201.25@tcp:38:mount.lustre.0 Request processed in 38970us (39735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790872.858542:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:2.0:1787790872.861665:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790872.862074:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790872.862257:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236601088 00000100:00100000:0.0:1787790872.862271:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236601088 00000100:00100000:0.0:1787790872.862381:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236601216 00000100:00100000:0.0:1787790872.862384:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236601216 00000100:00100000:0.0:1787790872.862412:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:0.0:1787790872.862424:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+7:0:x1874634236601088:12345-192.168.201.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787790872.862490:0:14413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787790872.862616:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+7:0:x1874634236601088:12345-192.168.201.25@tcp:41:mount.lustre.0 Request processed in 192us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790872.862624:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:0.0:1787790872.862647:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:0.0:1787790872.862655:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7beff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+6:13751:x1874634236601216:12345-192.168.201.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787790872.862667:0:14413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787790872.862690:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7beff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+6:13751:x1874634236601216:12345-192.168.201.25@tcp:41:mount.lustre.0 Request processed in 37us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790872.862697:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00080000:2.0:1787790872.863347:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790872.865399:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790872.865544:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236601344 00000100:00100000:0.0:1787790872.865571:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236601344 00000100:00100000:0.0:1787790872.865638:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:0.0:1787790872.865648:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+6:13751:x1874634236601344:12345-192.168.201.25@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787790872.866018:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+6:13751:x1874634236601344:12345-192.168.201.25@tcp:40:mount.lustre.0 Request processed in 369us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790872.866027:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:0.0:1787790872.869318:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790872.869374:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790872.869476:0:15889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236601472 00000100:00100000:3.0:1787790872.869489:0:15889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236601472 00000100:00100000:3.0:1787790872.869544:0:15889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236601600 00000100:00100000:3.0:1787790872.869548:0:15889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236601600 00000100:00100000:3.0:1787790872.869588:0:15889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:3.0:1787790872.869598:0:15889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be19a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2345:x1874634236601472:12345-192.168.201.25@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787790872.869643:0:15889:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6@192.168.201.25@tcp t0 exp 0000000000000000 cur 407 last 0 00000020:00000080:3.0:1787790872.869695:0:15889:0:(genops.c:1385:class_connect()) connect: client a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6, cookie 0x70647b5fa9775631 00002000:00100000:3.0:1787790872.869715:0:15889:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6/ffff9319446e1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787790872.869792:0:15889:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787790872.870276:0:15889:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787790872.870322:0:15889:0:(import.c:65:import_set_state_nolock()) ffff9319446e6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790872.870442:0:15889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be19a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+6:2345:x1874634236601472:12345-192.168.201.25@tcp:8:mount.lustre.0 Request processed in 843us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790872.870452:0:15889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:3.0:1787790872.870482:0:15889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:3.0:1787790872.870487:0:15889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2345:x1874634236601600:12345-192.168.201.25@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787790872.870507:0:15889:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6@192.168.201.25@tcp t0 exp 0000000000000000 cur 407 last 0 00000020:00000080:3.0:1787790872.870531:0:15889:0:(genops.c:1385:class_connect()) connect: client a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6, cookie 0x70647b5fa9775638 00002000:00100000:3.0:1787790872.870539:0:15889:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6/ffff9319446e5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787790872.870558:0:15889:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787790872.870886:0:15889:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787790872.870908:0:15889:0:(import.c:65:import_set_state_nolock()) ffff9319446e7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790872.870937:0:15889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+6:2345:x1874634236601600:12345-192.168.201.25@tcp:8:mount.lustre.0 Request processed in 448us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790872.870945:0:15889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:2.0:1787790872.874064:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790872.874417:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236601728 00000100:00100000:1.0:1787790872.874431:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236601728 00000100:00100000:1.0:1787790872.874501:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:1.0:1787790872.874513:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+6:13751:x1874634236601728:12345-192.168.201.25@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787790872.877064:0:14414:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2447us 00000004:00200000:1.0:1787790872.891640:0:14414:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787790872.892155:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+6:13751:x1874634236601728:12345-192.168.201.25@tcp:33:mount.lustre.0 Request processed in 17631us (18094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790872.892171:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00000040:00080000:3.0:1787790872.961825:0:14444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787790873.016926:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790873.017051:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236601856 00000100:00100000:0.0:1787790873.017064:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236601856 00000100:00100000:0.0:1787790873.017159:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:0.0:1787790873.017171:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+6:13795:x1874634236601856:12345-192.168.201.25@tcp:101:mkdir.0 00010000:00010000:0.0:1787790873.017200:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790873.017436:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977563f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ee7a expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790873.017537:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9775646 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790873.017552:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9775646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790873.017567:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9775646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790873.017841:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787790873.017846:0:14411:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787790873.018182:0:14411:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9775646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790873.018219:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977563f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee7a expref: 8 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790873.018289:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9775646 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee7a expref: 7 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790873.018574:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a543e4700) 00010000:00010000:1.0:1787790873.018578:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787790873.018582:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67980e00, rc 0) 00000100:00100000:1.0:1787790873.018667:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+7:13795:x1874634236601856:12345-192.168.201.25@tcp:101:mkdir.0 Request processed in 1497us (1756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790873.018678:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00010000:00010000:3.0:1787790873.728190:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790874.752491:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787790874.776067:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6 00000100:00100000:0.0:1787790874.854829:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790874.857909:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236601984 00000100:00100000:1.0:1787790874.857985:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236601984 00000100:00100000:1.0:1787790874.858683:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:1.0:1787790874.858694:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+7:13847:x1874634236601984:12345-192.168.201.25@tcp:41:lfs.0 00000004:00000024:1.0:1787790874.858764:0:14412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787790874.858859:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+7:13847:x1874634236601984:12345-192.168.201.25@tcp:41:lfs.0 Request processed in 167us (4040us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790874.858868:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00080000:2.0:1787790874.858998:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790874.862874:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790874.863060:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236602112 00000100:00100000:3.0:1787790874.863207:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236602112 00000100:00100000:3.0:1787790874.863360:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:3.0:1787790874.863372:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7befde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+6:13847:x1874634236602112:12345-192.168.201.25@tcp:13:lfs.0 00002000:00000024:3.0:1787790874.863425:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790874.863523:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7befde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+6:13847:x1874634236602112:12345-192.168.201.25@tcp:13:lfs.0 Request processed in 152us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790874.863531:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00080000:2.0:1787790874.864288:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790874.866677:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790874.866992:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236602240 00000100:00100000:0.0:1787790874.867027:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236602240 00000100:00100000:0.0:1787790874.867136:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:0.0:1787790874.867151:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+5:13847:x1874634236602240:12345-192.168.201.25@tcp:13:lfs.0 00002000:00000024:0.0:1787790874.867226:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787790874.867365:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+5:13847:x1874634236602240:12345-192.168.201.25@tcp:13:lfs.0 Request processed in 217us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790874.867374:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00080000:2.0:1787790874.867771:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790875.084982:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790875.086465:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236602368 00000100:00100000:0.0:1787790875.086488:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236602368 00000100:00100000:0.0:1787790875.086664:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 91 00000100:00100000:0.0:1787790875.086688:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+10:13881:x1874634236602368:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787790875.086739:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790875.086766:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a67981a00/0x70647b5fa977564d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496ee81 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790875.086819:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a67981a00/0x70647b5fa977564d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee81 expref: 11 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790875.086833:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a67981a00/0x70647b5fa977564d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee81 expref: 11 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790875.086844:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981a00, rc 0) 00000100:00100000:0.0:1787790875.086933:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+11:13881:x1874634236602368:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 258us (1972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790875.086941:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 91 00000100:00100000:1.0:1787790875.093425:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790875.093846:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236602496 00000100:00100000:2.0:1787790875.093862:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236602496 00000100:00100000:2.0:1787790875.093940:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 92 00000100:00100000:2.0:1787790875.093951:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+11:13881:x1874634236602496:12345-192.168.201.25@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787790875.094467:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+11:13881:x1874634236602496:12345-192.168.201.25@tcp:501:mount.lustre.0 Request processed in 515us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790875.094478:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 92 00000100:00100000:3.0:1787790875.099040:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790875.099910:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236602624 00000100:00100000:0.0:1787790875.099929:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236602624 00000100:00100000:0.0:1787790875.100025:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 93 00000100:00100000:0.0:1787790875.100058:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+11:13881:x1874634236602624:12345-192.168.201.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787790875.100435:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+11:13881:x1874634236602624:12345-192.168.201.25@tcp:503:mount.lustre.0 Request processed in 379us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790875.100445:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 93 00000100:00100000:0.0:1787790875.104557:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790875.105020:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236602752 00000100:00100000:1.0:1787790875.105036:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236602752 00000100:00100000:1.0:1787790875.105118:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 94 00000100:00100000:1.0:1787790875.105131:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7b87c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+11:13886:x1874634236602752:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787790875.105781:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7b87c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+11:13886:x1874634236602752:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 639us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790875.105799:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 94 00000100:00100000:1.0:1787790875.123556:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790875.123847:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236602880 00000100:00100000:2.0:1787790875.123863:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236602880 00000100:00100000:2.0:1787790875.124008:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 95 00000100:00100000:2.0:1787790875.124022:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+11:13886:x1874634236602880:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787790875.124523:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+11:13886:x1874634236602880:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 501us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790875.124536:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 95 00000100:00100000:3.0:1787790875.133222:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790875.133462:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236603008 00000100:00100000:1.0:1787790875.133477:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236603008 00000100:00100000:1.0:1787790875.133560:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 96 00000100:00100000:1.0:1787790875.133572:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+11:13881:x1874634236603008:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787790875.133595:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790875.133623:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a542f1000/0x70647b5fa9775654 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496eeab expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790875.133664:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a542f1000/0x70647b5fa9775654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eeab expref: 12 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790875.133678:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a542f1000/0x70647b5fa9775654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eeab expref: 12 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790875.133687:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f1000, rc 0) 00000100:00100000:1.0:1787790875.133824:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+12:13881:x1874634236603008:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 254us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790875.133832:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 96 00000100:00100000:1.0:1787790875.138220:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790875.138330:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236603136 00000100:00100000:0.0:1787790875.138345:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236603136 00000100:00100000:0.0:1787790875.138426:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 97 00000100:00100000:0.0:1787790875.138438:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+12:13881:x1874634236603136:12345-192.168.201.25@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787790875.138475:0:14407:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787790875.138510:0:14407:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787790875.138514:0:14407:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787790875.138518:0:14407:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787790875.138521:0:14407:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787790875.141488:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+12:13881:x1874634236603136:12345-192.168.201.25@tcp:256:mount.lustre.0 Request processed in 3024us (3268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790875.141508:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 97 00000100:00100000:3.0:1787790875.144818:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790875.144978:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236603264 00000100:00100000:2.0:1787790875.144993:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236603264 00000100:00100000:2.0:1787790875.145168:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 98 00000100:00100000:2.0:1787790875.145184:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+12:13881:x1874634236603264:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787790875.145218:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790875.145243:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a4654f400/0x70647b5fa977565b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496eeb2 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.145295:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a4654f400/0x70647b5fa977565b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eeb2 expref: 13 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.145317:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a4654f400/0x70647b5fa977565b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eeb2 expref: 13 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.145360:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654f400, rc 0) 00000100:00100000:2.0:1787790875.145450:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+13:13881:x1874634236603264:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 270us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790875.145457:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 98 00000100:00100000:3.0:1787790875.148635:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790875.153440:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236603392 00000100:00100000:1.0:1787790875.153466:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236603392 00000100:00100000:2.0:1787790875.153978:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 99 00000100:00100000:2.0:1787790875.153996:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+13:13881:x1874634236603392:12345-192.168.201.25@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787790875.155672:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+13:13881:x1874634236603392:12345-192.168.201.25@tcp:501:mount.lustre.0 Request processed in 1668us (7041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790875.155687:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 99 00000100:00100000:0.0:1787790875.160954:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790875.161035:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236603520 00000100:00100000:1.0:1787790875.161050:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236603520 00000100:00100000:1.0:1787790875.161136:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 100 00000100:00100000:1.0:1787790875.161151:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+13:13881:x1874634236603520:12345-192.168.201.25@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787790875.162187:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+13:13881:x1874634236603520:12345-192.168.201.25@tcp:503:mount.lustre.0 Request processed in 1037us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790875.162197:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 100 00000100:00100000:3.0:1787790875.165436:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790875.165499:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236603648 00000100:00100000:2.0:1787790875.165512:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236603648 00000100:00100000:2.0:1787790875.165622:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 101 00000100:00100000:2.0:1787790875.165634:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+13:13890:x1874634236603648:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787790875.166009:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+13:13890:x1874634236603648:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 375us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790875.166029:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 101 00000100:00100000:3.0:1787790875.168942:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790875.169034:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236603776 00000100:00100000:1.0:1787790875.169050:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236603776 00000100:00100000:1.0:1787790875.169173:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 102 00000100:00100000:1.0:1787790875.169185:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+13:13890:x1874634236603776:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787790875.169669:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+13:13890:x1874634236603776:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 485us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790875.169680:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 102 00000100:00100000:1.0:1787790875.183093:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790875.183534:0:15693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236603904 00000100:00100000:3.0:1787790875.183549:0:15693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236603904 00000100:00100000:3.0:1787790875.183614:0:15693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:3.0:1787790875.183625:0:15693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2345:x1874634236603904:12345-192.168.201.25@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787790875.183686:0:15693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3@192.168.201.25@tcp t0 exp 0000000000000000 cur 410 last 0 00000020:00000080:3.0:1787790875.183803:0:15693:0:(genops.c:1385:class_connect()) connect: client 1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3, cookie 0x70647b5fa9775662 00000004:00100000:3.0:1787790875.183845:0:15693:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787790875.184009:0:15693:0:(import.c:65:import_set_state_nolock()) ffff931945a11000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790875.184107:0:15693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+6:2345:x1874634236603904:12345-192.168.201.25@tcp:38:mount.lustre.0 Request processed in 482us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790875.184117:0:15693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:3.0:1787790875.198610:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790875.198656:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790875.199404:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236604032 00000100:00100000:0.0:1787790875.199420:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236604032 00000100:00100000:0.0:1787790875.199515:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236604160 00000100:00100000:0.0:1787790875.199519:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236604160 00000100:00100000:0.0:1787790875.199551:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:0.0:1787790875.199563:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+7:0:x1874634236604032:12345-192.168.201.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787790875.199623:0:14413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787790875.199761:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+7:0:x1874634236604032:12345-192.168.201.25@tcp:41:mount.lustre.0 Request processed in 159us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790875.199800:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:0.0:1787790875.199822:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:0.0:1787790875.199829:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+6:13881:x1874634236604160:12345-192.168.201.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787790875.199850:0:14413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787790875.199874:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+6:13881:x1874634236604160:12345-192.168.201.25@tcp:41:mount.lustre.0 Request processed in 46us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790875.199880:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00080000:2.0:1787790875.200237:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790875.202371:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790875.202518:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236604288 00000100:00100000:0.0:1787790875.202530:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236604288 00000100:00100000:0.0:1787790875.202598:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:0.0:1787790875.202611:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+6:13881:x1874634236604288:12345-192.168.201.25@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787790875.202789:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+6:13881:x1874634236604288:12345-192.168.201.25@tcp:40:mount.lustre.0 Request processed in 180us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790875.202798:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:0.0:1787790875.206665:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790875.206891:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236604672 00000100:00100000:2.0:1787790875.206905:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236604672 00000100:00100000:2.0:1787790875.206978:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:2.0:1787790875.206991:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+6:13881:x1874634236604672:12345-192.168.201.25@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787790875.208383:0:14415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787790875.209570:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+6:13881:x1874634236604672:12345-192.168.201.25@tcp:33:mount.lustre.0 Request processed in 2562us (2903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790875.209607:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:1.0:1787790875.210692:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790875.211559:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790875.213200:0:15889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236604416 00000100:00100000:2.0:1787790875.213403:0:15889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236604416 00000100:00100000:2.0:1787790875.213513:0:15889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236604544 00000100:00100000:2.0:1787790875.213518:0:15889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236604544 00000100:00100000:0.0:1787790875.213566:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:0.0:1787790875.213578:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1874634236604416:12345-192.168.201.25@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787790875.213630:0:15096:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3@192.168.201.25@tcp t0 exp 0000000000000000 cur 410 last 0 00000020:00000080:0.0:1787790875.213689:0:15096:0:(genops.c:1385:class_connect()) connect: client 1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3, cookie 0x70647b5fa9775669 00002000:00100000:0.0:1787790875.213708:0:15096:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3/ffff931a42e71000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787790875.213761:0:15096:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787790875.213949:0:15096:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787790875.213992:0:15096:0:(import.c:65:import_set_state_nolock()) ffff931a42e75800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787790875.214380:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+6:2345:x1874634236604416:12345-192.168.201.25@tcp:8:mount.lustre.0 Request processed in 801us (3701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790875.214391:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:0.0:1787790875.214418:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:0.0:1787790875.214424:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1874634236604544:12345-192.168.201.25@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787790875.214444:0:15096:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3@192.168.201.25@tcp t0 exp 0000000000000000 cur 410 last 0 00000020:00000080:0.0:1787790875.214471:0:15096:0:(genops.c:1385:class_connect()) connect: client 1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3, cookie 0x70647b5fa9775670 00002000:00100000:0.0:1787790875.214477:0:15096:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3/ffff931a42e73800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787790875.214484:0:15096:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787790875.214761:0:15096:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787790875.214992:0:15096:0:(import.c:65:import_set_state_nolock()) ffff931a42e70800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787790875.215140:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+6:2345:x1874634236604544:12345-192.168.201.25@tcp:8:mount.lustre.0 Request processed in 713us (3584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790875.215148:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:3.0:1787790875.370280:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790875.370610:0:15693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236604800 00000100:00100000:1.0:1787790875.370625:0:15693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236604800 00000100:00100000:1.0:1787790875.370781:0:15693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:1.0:1787790875.370796:0:15693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+6:13911:x1874634236604800:12345-192.168.201.25@tcp:101:mkdir.0 00010000:00010000:1.0:1787790875.370829:0:15693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790875.370861:0:15693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa9775677 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eedc expref: -99 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790875.370960:0:15693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977567e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790875.370982:0:15693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977567e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790875.371029:0:15693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977567e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790875.371353:0:15693:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787790875.371359:0:15693:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787790875.371448:0:15693:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977567e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790875.371482:0:15693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0c00/0x70647b5fa9775677 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eedc expref: 8 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790875.371505:0:15693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977567e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eedc expref: 7 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790875.371514:0:15693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a543e4700) 00010000:00010000:1.0:1787790875.371518:0:15693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787790875.371523:0:15693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f1200, rc 0) 00000100:00100000:1.0:1787790875.371607:0:15693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+7:13911:x1874634236604800:12345-192.168.201.25@tcp:101:mkdir.0 Request processed in 816us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790875.371616:0:15693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:1.0:1787790875.712355:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253369600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790875.712461:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790875.712606:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253369600 00000100:00100000:3.0:1787790875.712616:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253369600 00000100:00100000:3.0:1787790875.712706:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787790875.712755:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf11680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253369600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790875.712789:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790875.712850:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf11680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253369600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790875.712857:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787790875.713001:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8529acdd-b606-48f0-be71-c40064ed5481:3321:1874634253369344:0@lo:400:kworker.0 00000100:00100000:2.0:1787790875.713063:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790875.713100:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7bf10780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253369472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790875.713128:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790875.713230:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253369600:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787790875.713261:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790875.713398:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253369344 00000100:00100000:3.0:1787790875.713402:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253369344 00000100:00100000:3.0:1787790875.713439:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787790875.713446:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+19:3321:x1874634253369344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790875.713524:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253369472 00000100:00100000:1.0:1787790875.713528:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253369472 00000100:00100000:1.0:1787790875.713560:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787790875.713588:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253369472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787790875.713601:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790875.716829:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+19:3321:x1874634253369344:12345-0@lo:400:kworker.0 Request processed in 3363us (3745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790875.716852:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787790875.717008:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253369856:0@lo:400:kworker.0 00000100:00100000:3.0:1787790875.717167:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787790875.717254:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787790875.717280:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874634253369728:0@lo:400:kworker.0 00000100:00100000:3.0:1787790875.717309:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790875.717345:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253369856 00000100:00100000:3.0:1787790875.717355:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253369856 00000100:00100000:3.0:1787790875.717413:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253369728 00000100:00100000:3.0:1787790875.717417:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253369728 00000100:00100000:3.0:1787790875.717441:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787790875.717450:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253369856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790875.717504:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253369856:12345-0@lo:400:kworker.0 Request processed in 55us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790875.717511:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787790875.717526:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787790875.717531:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874634253369728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790875.717559:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874634253369728:12345-0@lo:400:kworker.0 Request processed in 28us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790875.717566:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787790875.717607:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874634253369728:0@lo:400:kworker.0 00000100:00100000:3.0:1787790875.717640:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253369856:0@lo:400:kworker.0 00000100:00080000:3.0:1787790875.717652:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790875.717837:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253369472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4245us (4704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790875.717849:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787790875.718000:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8529acdd-b606-48f0-be71-c40064ed5481:3321:1874634253369344:0@lo:400:kworker.0 00000100:00100000:2.0:1787790875.718030:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7bf10780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253369472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790875.719982:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790875.720011:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1874634253369984:0@lo:400:kworker.0 00000100:00100000:0.0:1787790875.720317:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790875.720396:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253369984 00000100:00100000:0.0:1787790875.720405:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253369984 00000100:00100000:0.0:1787790875.720481:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787790875.720490:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874634253369984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790875.720550:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874634253369984:12345-0@lo:400:kworker.0 Request processed in 58us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790875.720557:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1787790875.720581:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790875.720637:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1874634253369984:0@lo:400:kworker.0 00010000:00010000:3.0:1787790875.777593:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790876.800166:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787790877.811392:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3 00000001:00100000:3.0:1787790877.811421:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6 00010000:00010000:3.0:1787790877.824067:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787790877.845431:0:16371:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1787790878.343609:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6 00000001:00100000:3.0:1787790878.343647:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3 00010000:00010000:0.0:1787790878.851633:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790879.892192:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787790879.896327:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3 00000100:00100000:1.0:1787790880.705909:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790880.705955:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790880.705978:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790880.706006:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790880.706026:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790880.706049:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790880.706077:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790880.706106:0:15693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236605056 00000100:00100000:1.0:1787790880.706127:0:15693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236605056 00000100:00100000:1.0:1787790880.706188:0:15693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236605440 00000100:00100000:1.0:1787790880.706192:0:15693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236605440 00000100:00100000:1.0:1787790880.706214:0:15693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:1.0:1787790880.706224:0:15693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7bf12940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+6:2349:x1874634236605056:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790880.706316:0:15693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7bf12940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+6:2349:x1874634236605056:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 93us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790880.706324:0:15693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:1.0:1787790880.706341:0:15693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:1.0:1787790880.706346:0:15693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+6:2348:x1874634236605440:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790880.706370:0:15693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+6:2348:x1874634236605440:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 24us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790880.706389:0:15693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:1.0:1787790880.706408:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236604928 00000100:00100000:1.0:1787790880.706411:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236604928 00000100:00100000:1.0:1787790880.706437:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 104 00000100:00100000:1.0:1787790880.706445:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+13:2348:x1874634236604928:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790880.706470:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+13:2348:x1874634236604928:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 27us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790880.706482:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 104 00000100:00100000:1.0:1787790880.706515:0:15889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236605184 00000100:00100000:1.0:1787790880.706519:0:15889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236605184 00000100:00100000:1.0:1787790880.706541:0:15889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236605696 00000100:00100000:1.0:1787790880.706544:0:15889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236605696 00000100:00100000:1.0:1787790880.706557:0:15889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236605312 00000100:00100000:1.0:1787790880.706559:0:15889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236605312 00000100:00100000:1.0:1787790880.706570:0:15889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236605568 00000100:00100000:1.0:1787790880.706572:0:15889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236605568 00000100:00100000:1.0:1787790880.706585:0:15889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:1.0:1787790880.706592:0:15889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a811992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+5:2348:x1874634236605184:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790880.706618:0:15889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a811992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+5:2348:x1874634236605184:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 27us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790880.706624:0:15889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:1.0:1787790880.706635:0:15889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:1.0:1787790880.706641:0:15889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+5:2348:x1874634236605696:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790880.706662:0:15889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+5:2348:x1874634236605696:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 22us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790880.706667:0:15889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:1.0:1787790880.706685:0:15889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:1.0:1787790880.706691:0:15889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a811983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+5:2349:x1874634236605312:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790880.706717:0:15889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a811983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+5:2349:x1874634236605312:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 26us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790880.706750:0:15889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:1.0:1787790880.706762:0:15889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:1.0:1787790880.706768:0:15889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81199a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+5:2349:x1874634236605568:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1787790880.706792:0:15889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81199a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+5:2349:x1874634236605568:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 24us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790880.706798:0:15889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00080000:0.0:1787790880.707041:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787790880.707046:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787790880.707049:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790880.833714:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81199680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253370112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790880.833809:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790880.833875:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790880.833882:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253370240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790880.833907:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790880.833943:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253370112 00000100:00100000:3.0:1787790880.833949:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253370112 00000100:00100000:3.0:1787790880.834008:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253370240 00000100:00100000:3.0:1787790880.834011:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253370240 00000100:00100000:3.0:1787790880.834030:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787790880.834041:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d9583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253370112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787790880.834080:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790880.834143:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d9583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253370112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790880.834152:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787790880.834173:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787790880.834180:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d959e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253370240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790880.834199:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790880.834227:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d959e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253370240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790880.834233:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787790880.834250:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787790880.834254:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787790880.834320:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253370240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790880.834333:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81199680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253370112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790880.837252:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81198780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253370496:0@lo:400:kworker.0 00000100:00100000:1.0:1787790880.837333:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790880.837371:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787790880.837377:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8119a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8529acdd-b606-48f0-be71-c40064ed5481:3321:1874634253370368:0@lo:400:kworker.0 00000100:00100000:1.0:1787790880.837405:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790880.837437:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8119bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253370624:0@lo:400:kworker.0 00000100:00100000:1.0:1787790880.837473:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790880.837492:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790880.837497:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a81199e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1874634253370752:0@lo:400:kworker.0 00000100:00100000:1.0:1787790880.837516:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790880.837547:0:15693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253370496 00000100:00100000:1.0:1787790880.837553:0:15693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253370496 00000100:00100000:1.0:1787790880.837592:0:15693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253370624 00000100:00100000:1.0:1787790880.837595:0:15693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253370624 00000100:00100000:1.0:1787790880.837619:0:15693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253370752 00000100:00100000:1.0:1787790880.837621:0:15693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253370752 00000100:00100000:1.0:1787790880.837657:0:15693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787790880.837665:0:15693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253370496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790880.837715:0:15693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874634253370496:12345-0@lo:400:kworker.0 Request processed in 51us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790880.837745:0:15693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787790880.837762:0:15693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787790880.837770:0:15693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81198b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253370624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790880.837801:0:15693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81198b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874634253370624:12345-0@lo:400:kworker.0 Request processed in 33us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790880.837807:0:15693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787790880.837819:0:15693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787790880.837824:0:15693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874634253370752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790880.837867:0:15693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874634253370752:12345-0@lo:400:kworker.0 Request processed in 43us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790880.837873:0:15693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787790880.837891:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253370368 00000100:00100000:1.0:1787790880.837894:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253370368 00000100:00100000:1.0:1787790880.837917:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787790880.837922:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+19:3321:x1874634253370368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790880.837949:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+19:3321:x1874634253370368:12345-0@lo:400:kworker.0 Request processed in 27us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790880.837954:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1787790880.837985:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790880.838014:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81199e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1874634253370752:0@lo:400:kworker.0 00000100:00100000:1.0:1787790880.838025:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8119bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1874634253370624:0@lo:400:kworker.0 00000100:00100000:1.0:1787790880.838063:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8119a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8529acdd-b606-48f0-be71-c40064ed5481:3321:1874634253370368:0@lo:400:kworker.0 00000100:00100000:1.0:1787790880.838073:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a81198780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874634253370496:0@lo:400:kworker.0 00010000:00010000:0.0:1787790880.898804:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787790881.042005:0:16522:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd43be2b40 20000000:00000080:2.0:1787790881.042026:0:16522:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9319457cf800 uarg=0000000000000000 20000000:01000000:2.0:1787790881.042067:0:16522:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787790881.042075:0:16522:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787790881.042082:0:16522:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787790881.043205:0:16523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1787790881.043384:0:16522:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787790881.050795:0:16522:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787790881.051181:0:16522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff931a82152800/0x70647b5fa9775685 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790881.051204:0:16522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a4654fc00/0x70647b5fa977537c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9775375 expref: 18 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790881.051214:0:16522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a67981c00/0x70647b5fa97753c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97753c2 expref: 18 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790881.051222:0:16522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a4654fe00/0x70647b5fa9775439 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa9775432 expref: 18 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790881.051232:0:16522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a542f0000/0x70647b5fa9775623 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee50 expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790881.051241:0:16522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff931a4654f400/0x70647b5fa977565b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eeb2 expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790881.051249:0:16522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff931a82152800/0x70647b5fa9775685 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790881.051302:0:16522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a4654f400/0x70647b5fa977565b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eeb2 expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790881.051319:0:16522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff931a4654f400/0x70647b5fa977565b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eeb2 expref: 12 pid: 14406 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790881.051335:0:16522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d9592c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16522:1874634253370880:192.168.201.25@tcp:104: 00010000:00010000:3.0:1787790881.051448:0:16522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a542f0000/0x70647b5fa9775623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee50 expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790881.051472:0:16522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff931a542f0000/0x70647b5fa9775623 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee50 expref: 12 pid: 14406 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790881.051481:0:16522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d958f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16522:1874634253371008:192.168.201.25@tcp:104: 00010000:00010000:3.0:1787790881.051511:0:16522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a4654fe00/0x70647b5fa9775439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa9775432 expref: 18 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790881.051520:0:16522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff931a4654fe00/0x70647b5fa9775439 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa9775432 expref: 18 pid: 14407 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790881.051539:0:16522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d95ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16522:1874634253371136:0@lo:104: 00000100:00100000:3.0:1787790881.052676:0:16522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787790881.052741:0:16522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a67981c00/0x70647b5fa97753c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa97753c2 expref: 18 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790881.052753:0:16522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff931a67981c00/0x70647b5fa97753c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa97753c2 expref: 18 pid: 14405 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790881.052765:0:16522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d95a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16522:1874634253371264:0@lo:104: 00000100:00100000:3.0:1787790881.052802:0:16522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787790881.052832:0:16522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff931a4654fc00/0x70647b5fa977537c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70647b5fa9775375 expref: 18 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790881.052840:0:16522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff931a4654fc00/0x70647b5fa977537c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70647b5fa9775375 expref: 18 pid: 14407 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790881.052848:0:16522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7d958000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16522:1874634253371392:0@lo:104: 00000100:00100000:3.0:1787790881.052872:0:16522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790881.052895:0:16522:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a45081240 going to sleep for 11 seconds 00000100:00100000:2.0:1787790881.053258:0:14396:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787790881.053276:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253371136 00000100:00100000:2.0:1787790881.053284:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253371136 00000100:00100000:2.0:1787790881.053351:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253371264 00000100:00100000:2.0:1787790881.053355:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253371264 00000100:00100000:2.0:1787790881.053367:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253371392 00000100:00100000:2.0:1787790881.053369:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253371392 00000100:00100000:2.0:1787790881.053394:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787790881.053403:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d959680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8529acdd-b606-48f0-be71-c40064ed5481+5:16522:x1874634253371136:12345-0@lo:104: 00010000:00010000:2.0:1787790881.053416:0:14396:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a45704800/0x70647b5fa9775432 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9775439 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.053474:0:14396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787790881.053480:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d959680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8529acdd-b606-48f0-be71-c40064ed5481+5:16522:x1874634253371136:12345-0@lo:104: Request processed in 79us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790881.053487:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787790881.053508:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787790881.053514:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d958780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8529acdd-b606-48f0-be71-c40064ed5481+4:16522:x1874634253371264:12345-0@lo:104: 00010000:00010000:2.0:1787790881.053522:0:14396:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97753c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97753c9 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.053553:0:14396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787790881.053558:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d958780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8529acdd-b606-48f0-be71-c40064ed5481+4:16522:x1874634253371264:12345-0@lo:104: Request processed in 45us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790881.053564:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787790881.053577:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787790881.053584:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944e9c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8529acdd-b606-48f0-be71-c40064ed5481+3:16522:x1874634253371392:12345-0@lo:104: 00010000:00010000:2.0:1787790881.053592:0:14396:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9775375 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa977537c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.053619:0:14396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787790881.053624:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944e9c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8529acdd-b606-48f0-be71-c40064ed5481+3:16522:x1874634253371392:12345-0@lo:104: Request processed in 42us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790881.053630:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787790881.053683:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787790881.053696:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a45704800/0x70647b5fa9775432 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa9775439 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.053704:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704800 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:2.0:1787790881.053708:0:14400:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a45704800/0x70647b5fa9775432 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa9775439 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.053716:0:14400:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a45704800/0x70647b5fa9775432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa9775439 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790881.053745:0:14400:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a45704800/0x70647b5fa9775432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa9775439 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790881.053752:0:14400:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787790881.053785:0:14400:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a45704800/0x70647b5fa9775432 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9775439 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.053791:0:14400:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790881.053812:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a45704800/0x70647b5fa9775432 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9775439 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.053819:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a45704800/0x70647b5fa9775432 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa9775439 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.053831:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787790881.053834:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97753c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa97753c9 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.053840:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67980a00 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:2.0:1787790881.053842:0:14400:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97753c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa97753c9 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.053858:0:14400:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97753c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa97753c9 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790881.053863:0:14400:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97753c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa97753c9 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790881.053868:0:14400:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787790881.053880:0:14400:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97753c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97753c9 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.053885:0:14400:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790881.053890:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97753c2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97753c9 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.053896:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97753c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa97753c9 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.053904:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790881.053906:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9775375 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70647b5fa977537c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.053911:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a45704600 already unused, calling callback (ffffffffc1e05c20) 10000000:00010000:2.0:1787790881.053914:0:14400:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9775375 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x70647b5fa977537c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.053920:0:14400:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9775375 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x70647b5fa977537c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790881.053927:0:14400:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9775375 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x70647b5fa977537c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790881.053936:0:14400:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787790881.053950:0:14400:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9775375 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa977537c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.053955:0:14400:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790881.053971:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9775375 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa977537c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.053978:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff931a45704600/0x70647b5fa9775375 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70647b5fa977537c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.053993:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790881.053994:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790881.053996:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790881.054039:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8529acdd-b606-48f0-be71-c40064ed5481:3318:1874634253371776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790881.054073:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790881.054133:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8529acdd-b606-48f0-be71-c40064ed5481:3321:1874634253371648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790881.054157:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790881.054180:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787790881.054185:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8529acdd-b606-48f0-be71-c40064ed5481:3321:1874634253371520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790881.054204:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790881.054238:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253371776 00000100:00100000:2.0:1787790881.054242:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253371776 00010000:00010000:2.0:1787790881.054262:0:14399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a4654fc00/0x70647b5fa977537c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9775375 expref: 19 pid: 14407 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790881.054278:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253371648 00000100:00100000:2.0:1787790881.054281:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253371648 00010000:00010000:2.0:1787790881.054300:0:14399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a67981c00/0x70647b5fa97753c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97753c2 expref: 20 pid: 14405 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790881.054312:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253371520 00000100:00100000:2.0:1787790881.054314:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253371520 00010000:00010000:2.0:1787790881.054323:0:14399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a4654fe00/0x70647b5fa9775439 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9775432 expref: 21 pid: 14407 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790881.054334:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787790881.054340:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db68b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8529acdd-b606-48f0-be71-c40064ed5481+21:3318:x1874634253371776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787790881.054349:0:14399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790881.054355:0:14399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a4654fc00/0x70647b5fa977537c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9775375 expref: 21 pid: 14407 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.054364:0:14399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a4654fc00/0x70647b5fa977537c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa9775375 expref: 21 pid: 14407 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.054382:0:14399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790881.054412:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db68b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8529acdd-b606-48f0-be71-c40064ed5481+21:3318:x1874634253371776:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790881.054419:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787790881.054431:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787790881.054437:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db69680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8529acdd-b606-48f0-be71-c40064ed5481+20:3321:x1874634253371648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787790881.054444:0:14399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790881.054448:0:14399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a67981c00/0x70647b5fa97753c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa97753c2 expref: 20 pid: 14405 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.054455:0:14399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a67981c00/0x70647b5fa97753c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa97753c2 expref: 20 pid: 14405 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.054476:0:14399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790881.054502:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db69680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8529acdd-b606-48f0-be71-c40064ed5481+20:3321:x1874634253371648:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790881.054508:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787790881.054521:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787790881.054527:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8529acdd-b606-48f0-be71-c40064ed5481+19:3321:x1874634253371520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787790881.054534:0:14399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790881.054539:0:14399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a4654fe00/0x70647b5fa9775439 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70647b5fa9775432 expref: 19 pid: 14407 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.054547:0:14399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a4654fe00/0x70647b5fa9775439 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70647b5fa9775432 expref: 19 pid: 14407 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.054556:0:14399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790881.054575:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8529acdd-b606-48f0-be71-c40064ed5481+19:3321:x1874634253371520:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790881.054581:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787790881.054641:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8529acdd-b606-48f0-be71-c40064ed5481:3318:1874634253371776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790881.054665:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8529acdd-b606-48f0-be71-c40064ed5481:3321:1874634253371520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790881.054671:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8529acdd-b606-48f0-be71-c40064ed5481:3321:1874634253371648:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790881.054791:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790881.056164:0:16522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a4654fe00/0x70647b5fa9775439 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa9775432 expref: 18 pid: 14407 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790881.056183:0:16522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d95ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16522:1874634253371136:0@lo:104: 00010000:00010000:3.0:1787790881.056196:0:16522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a67981c00/0x70647b5fa97753c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa97753c2 expref: 17 pid: 14405 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790881.056203:0:16522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d95a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16522:1874634253371264:0@lo:104: 00010000:00010000:3.0:1787790881.056213:0:16522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a4654fc00/0x70647b5fa977537c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70647b5fa9775375 expref: 16 pid: 14407 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790881.056220:0:16522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d958000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16522:1874634253371392:0@lo:104: 00000100:00100000:3.0:1787790881.059505:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790881.059772:0:16522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d9592c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16522:1874634253370880:192.168.201.25@tcp:104: 00000100:00100000:0.0:1787790881.059798:0:16522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7d958f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16522:1874634253371008:192.168.201.25@tcp:104: 00010000:00010000:0.0:1787790881.059836:0:16522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff931a82152800/0x70647b5fa9775685 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790881.060318:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236605824 00000100:00100000:2.0:1787790881.060327:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236605824 00010000:00010000:2.0:1787790881.060369:0:14399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a4654f400/0x70647b5fa977565b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eeb2 expref: 13 pid: 14406 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790881.060412:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:2.0:1787790881.060433:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d95b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+13:2349:x1874634236605824:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790881.060450:0:14399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790881.060455:0:14399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a4654f400/0x70647b5fa977565b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eeb2 expref: 13 pid: 14406 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.060467:0:14399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a4654f400/0x70647b5fa977565b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eeb2 expref: 13 pid: 14406 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.060485:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a4654f400/0x70647b5fa977565b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eeb2 expref: 13 pid: 14406 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.060500:0:14399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790881.060854:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d95b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+12:2349:x1874634236605824:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 420us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790881.060862:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:0.0:1787790881.066233:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790881.066354:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236605952 00000100:00100000:2.0:1787790881.066363:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236605952 00010000:00010000:2.0:1787790881.066398:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff931a542f0000/0x70647b5fa9775623 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee50 expref: 12 pid: 14406 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790881.066431:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:2.0:1787790881.066440:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be19e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+12:2348:x1874634236605952:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790881.066454:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790881.066460:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff931a542f0000/0x70647b5fa9775623 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee50 expref: 12 pid: 14406 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.066472:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff931a542f0000/0x70647b5fa9775623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee50 expref: 12 pid: 14406 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.066509:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a542f0000/0x70647b5fa9775623 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee50 expref: 12 pid: 14406 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.066582:0:14397:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff931a82152800/0x70647b5fa9775685 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.066592:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a82152800/0x70647b5fa9775685 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.066607:0:14397:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a82152800/0x70647b5fa9775685 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.066614:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931a82152800/0x70647b5fa9775685 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.066621:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff931a82152800/0x70647b5fa9775685 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.066628:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff931a82152800/0x70647b5fa9775685 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.066688:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152800 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:2.0:1787790881.066693:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff931a82152800/0x70647b5fa9775685 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.066702:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff931a82152800/0x70647b5fa9775685 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790881.066904:0:16522:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff931a82152800/0x70647b5fa9775685 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790881.066913:0:16522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff931a82152800/0x70647b5fa9775685 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.067852:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff931a82152800/0x70647b5fa9775685 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.067875:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931a82152800/0x70647b5fa9775685 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790881.067891:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790881.067947:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be19e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+11:2348:x1874634236605952:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 1506us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790881.067956:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00010000:00010000:2.0:1787790881.923814:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787790882.177472:0:14444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787790882.607839:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790882.608011:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236606080 00000100:00100000:3.0:1787790882.608021:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236606080 00000100:00100000:3.0:1787790882.608092:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 106 00000100:00100000:3.0:1787790882.608104:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+11:13765:x1874634236606080:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790882.608123:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790882.608147:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a82153000/0x70647b5fa977568c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496eee3 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790882.608180:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a82153000/0x70647b5fa977568c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eee3 expref: 12 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790882.608192:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a82153000/0x70647b5fa977568c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eee3 expref: 12 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790882.608217:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153000, rc 0) 00000100:00100000:3.0:1787790882.608290:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+12:13765:x1874634236606080:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 187us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790882.608298:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 106 00000100:00100000:0.0:1787790882.621047:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790882.622374:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236606208 00000100:00100000:1.0:1787790882.622388:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236606208 00000100:00100000:1.0:1787790882.622448:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 107 00000100:00100000:1.0:1787790882.622457:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+12:13765:x1874634236606208:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790882.622793:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+12:13765:x1874634236606208:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 335us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790882.622802:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 107 00000100:00100000:3.0:1787790882.636414:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790882.636500:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236606336 00000100:00100000:2.0:1787790882.636512:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236606336 00000100:00100000:2.0:1787790882.636573:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 108 00000100:00100000:2.0:1787790882.636584:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+12:13765:x1874634236606336:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790882.636862:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+12:13765:x1874634236606336:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 Request processed in 280us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790882.636871:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 108 00000100:00100000:2.0:1787790882.656216:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790882.658183:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236606464 00000100:00100000:1.0:1787790882.658199:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236606464 00000100:00100000:1.0:1787790882.658261:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 109 00000100:00100000:1.0:1787790882.658272:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931944f0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+12:13765:x1874634236606464:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790882.658301:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790882.658322:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a542f0a00/0x70647b5fa9775693 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5a022183496eeea expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790882.658353:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a542f0a00/0x70647b5fa9775693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eeea expref: 13 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790882.658366:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a542f0a00/0x70647b5fa9775693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eeea expref: 13 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790882.658376:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f0a00, rc 0) 00000100:00100000:1.0:1787790882.658467:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931944f0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+13:13765:x1874634236606464:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 197us (2265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790882.666626:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 109 00000100:00100000:1.0:1787790882.667678:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790882.668087:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236606592 00000100:00100000:1.0:1787790882.668097:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236606592 00000100:00100000:1.0:1787790882.668774:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 110 00000100:00100000:1.0:1787790882.668789:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d73c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+13:13765:x1874634236606592:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790882.669820:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d73c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+13:13765:x1874634236606592:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 1030us (2141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790882.669942:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 110 00000100:00100000:3.0:1787790882.673834:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790882.675518:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236606720 00000100:00100000:1.0:1787790882.675539:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236606720 00000100:00100000:1.0:1787790882.675613:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 111 00000100:00100000:1.0:1787790882.675625:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d73e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+13:13765:x1874634236606720:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787790882.675966:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d73e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+13:13765:x1874634236606720:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 Request processed in 342us (2144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790882.675974:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 111 10000000:01000000:2.0:1787790882.945212:0:14409:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787790882.945222:0:14409:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff931945afb800 from 10 10000000:01000000:2.0:1787790882.945229:0:14409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787790882.945277:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa977569a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790882.945288:0:14409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa977569a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790882.945298:0:14409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa977569a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790882.945336:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db6b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253371904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787790882.945411:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790882.945477:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67d4b600 going to sleep for 11 seconds 00000100:00100000:1.0:1787790882.945644:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253371904 00000100:00100000:1.0:1787790882.945651:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253371904 00000100:00100000:1.0:1787790882.945709:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787790882.945719:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d73c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+16:14409:x1874634253371904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790882.945757:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790882.945771:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a542f0c00/0x70647b5fa97756a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa977569a expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790882.945804:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a542f0c00/0x70647b5fa97756a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa977569a expref: 17 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790882.945815:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a542f0c00/0x70647b5fa97756a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa977569a expref: 17 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790882.945824:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f0c00, rc 0) 00000100:00100000:1.0:1787790882.945872:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d73c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+17:14409:x1874634253371904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790882.945880:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787790882.946131:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db6b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253371904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790882.946146:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa977569a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97756a1 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790882.946155:0:14409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa977569a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97756a1 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790882.946213:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db6b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253372032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790882.946240:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790882.946269:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67d4b600 going to sleep for 11 seconds 00000100:00100000:1.0:1787790882.946483:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253372032 00000100:00100000:1.0:1787790882.946488:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253372032 00000100:00100000:1.0:1787790882.946522:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787790882.946529:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d73ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+17:14409:x1874634253372032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790882.946838:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d73ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+17:14409:x1874634253372032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790882.946845:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787790882.947245:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db6b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253372032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790882.947296:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253372160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790882.947345:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790882.947368:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a42f60b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787790882.947620:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253372160 00000100:00100000:1.0:1787790882.947625:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253372160 00000100:00100000:1.0:1787790882.947664:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787790882.947672:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d73c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+17:14409:x1874634253372160:12345-0@lo:503:ll_cfg_requeue.0 00010000:00010000:2.0:1787790882.950851:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790882.951844:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d73c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+17:14409:x1874634253372160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4166us (4492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790882.951859:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787790882.952243:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be18b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253372160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787790882.954452:0:16616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787790882.963364:0:14409:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787790882.963408:0:14409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787790882.963423:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa977569a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97756a1 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790882.963450:0:14409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a4654f200/0x70647b5fa977569a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97756a1 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790882.963461:0:14409:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787790882.963464:0:14409:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff931a5ffca000 from 10 10000000:01000000:0.0:1787790882.963467:0:14409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787790882.963518:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97756a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790882.963527:0:14409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97756a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790882.963614:0:14409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97756a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790882.963643:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253372288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787790882.963711:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790882.963864:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a42f60900 going to sleep for 11 seconds 00000100:00100000:2.0:1787790882.963877:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253372288 00000100:00100000:2.0:1787790882.963884:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253372288 00000100:00100000:2.0:1787790882.963941:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787790882.963951:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d73e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+17:14409:x1874634253372288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790882.963964:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790882.963977:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a4654e400/0x70647b5fa97756af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97756a8 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790882.964000:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a4654e400/0x70647b5fa97756af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97756a8 expref: 18 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790882.964021:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a4654e400/0x70647b5fa97756af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97756a8 expref: 18 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790882.964030:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654e400, rc 0) 00000100:00100000:2.0:1787790882.964088:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d73e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+18:14409:x1874634253372288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790882.964096:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787790882.965106:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253372288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790882.965127:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97756a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97756af expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790882.965139:0:14409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97756a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97756af expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790882.965213:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253372416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790882.965269:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790882.965317:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a42f60900 going to sleep for 11 seconds 00000100:00100000:3.0:1787790882.965321:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253372416 00000100:00100000:3.0:1787790882.965327:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253372416 00000100:00100000:3.0:1787790882.965369:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787790882.965378:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a44c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+18:14409:x1874634253372416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790882.965787:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a44c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+18:14409:x1874634253372416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 410us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790882.965794:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787790882.967226:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253372416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790882.967289:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253372544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790882.967353:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790882.967392:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a42f60900 going to sleep for 11 seconds 00000100:00100000:3.0:1787790882.967806:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253372544 00000100:00100000:3.0:1787790882.967812:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253372544 00000100:00100000:3.0:1787790882.967861:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787790882.967869:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a44c2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+18:14409:x1874634253372544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790882.968062:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a44c2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8529acdd-b606-48f0-be71-c40064ed5481+18:14409:x1874634253372544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790882.968070:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787790882.968159:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253372544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787790882.971412:0:16620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787790882.971656:0:14409:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787790882.971686:0:14409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787790882.971698:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97756a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97756af expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790882.971711:0:14409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a67980a00/0x70647b5fa97756a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97756af expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790882.971924:0:14409:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787790882.971928:0:14409:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff931a4b638800 from 10 10000000:01000000:2.0:1787790882.971932:0:14409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787790882.971968:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a4654e800/0x70647b5fa97756b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790882.971976:0:14409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff931a4654e800/0x70647b5fa97756b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790882.971987:0:14409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff931a4654e800/0x70647b5fa97756b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790882.972019:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db683c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253372672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787790882.972189:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790882.972235:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67d4bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787790882.972284:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253372672 00000100:00100000:1.0:1787790882.972296:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253372672 00000100:00100000:1.0:1787790882.972379:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787790882.972389:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a44c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+18:14409:x1874634253372672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790882.972407:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790882.972424:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff931a542f1800/0x70647b5fa97756bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x70647b5fa97756b6 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790882.972450:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931a542f1800/0x70647b5fa97756bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70647b5fa97756b6 expref: 19 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790882.972461:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff931a542f1800/0x70647b5fa97756bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70647b5fa97756b6 expref: 19 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790882.972471:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f1800, rc 0) 00000100:00100000:1.0:1787790882.972524:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a44c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8529acdd-b606-48f0-be71-c40064ed5481+19:14409:x1874634253372672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790882.972532:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787790882.972620:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db683c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253372672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790882.972634:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff931a4654e800/0x70647b5fa97756b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97756bd expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790882.972644:0:14409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff931a4654e800/0x70647b5fa97756b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x70647b5fa97756bd expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790882.972694:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db683c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253372800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790882.972749:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790882.973069:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67d4bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787790882.973113:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253372800 00000100:00100000:3.0:1787790882.973117:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253372800 00000100:00100000:3.0:1787790882.973143:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787790882.973151:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a44c28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+19:14409:x1874634253372800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790882.973432:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a44c28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+19:14409:x1874634253372800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790882.973440:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787790882.973827:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db683c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253372800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790882.973864:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db683c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253372928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790882.973905:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790882.978826:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67d4bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787790882.981895:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253372928 00000100:00100000:3.0:1787790882.981911:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253372928 00000100:00100000:3.0:1787790882.982898:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787790882.982913:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a44c2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+19:14409:x1874634253372928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790882.983242:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a44c2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+19:14409:x1874634253372928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 332us (9335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790882.983250:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787790882.983395:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db683c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8529acdd-b606-48f0-be71-c40064ed5481:14409:1874634253372928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787790882.984753:0:16623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787790882.984990:0:14409:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787790882.985013:0:14409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787790882.985084:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff931a4654e800/0x70647b5fa97756b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97756bd expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790882.985108:0:14409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff931a4654e800/0x70647b5fa97756b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70647b5fa97756bd expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790883.971539:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790884.220602:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790884.220768:0:15693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236606848 00000100:00100000:2.0:1787790884.220778:0:15693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236606848 00000100:00100000:2.0:1787790884.220862:0:15693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:2.0:1787790884.220874:0:15693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+6:14422:x1874634236606848:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787790884.220896:0:15693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790884.220922:0:15693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa97756c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eef1 expref: -99 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.220989:0:15693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa97756cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.221005:0:15693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa97756cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.221018:0:15693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa97756cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.221033:0:15693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97756d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.221040:0:15693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97756d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.221046:0:15693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97756d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.221836:0:15693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa97756d9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.221848:0:15693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa97756d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.221855:0:15693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa97756d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790884.222206:0:15693:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787790884.222211:0:15693:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787790884.222782:0:15693:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa97756d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.222796:0:15693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa97756cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.222804:0:15693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa97756cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.222810:0:15693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa97756cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.222816:0:15693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654f400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790884.222820:0:15693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa97756cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.222828:0:15693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa97756cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.222841:0:15693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a543e4700) 00010000:00010000:2.0:1787790884.222850:0:15693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790884.222855:0:15693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa97756cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.222862:0:15693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa97756cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.222875:0:15693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97756d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.222881:0:15693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97756d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.222887:0:15693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97756d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.222892:0:15693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654ee00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790884.222895:0:15693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97756d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.222901:0:15693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97756d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.222909:0:15693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff931a4b7e7e00) 00010000:00010000:2.0:1787790884.222912:0:15693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790884.222915:0:15693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97756d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.222920:0:15693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97756d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.222961:0:15693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa97756c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eef1 expref: 8 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.222988:0:15693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f600/0x70647b5fa97756d9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eef1 expref: 7 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.222995:0:15693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff931a4b7e7500) 00010000:00010000:2.0:1787790884.222997:0:15693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790884.222999:0:15693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654f600, rc 0) 00000100:00080000:1.0:1787790884.223305:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790884.223455:0:15693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+7:14422:x1874634236606848:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 2583us (2873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790884.223464:0:15693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:2.0:1787790884.234492:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790884.234654:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236607104 00000100:00100000:1.0:1787790884.234664:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236607104 00000100:00100000:1.0:1787790884.234770:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:1.0:1787790884.234782:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+7:14422:x1874634236607104:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790884.234804:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790884.234827:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa97756e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eef8 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.234916:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa97756e7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.234945:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa97756e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.234959:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa97756e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.235030:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa97756ee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.235038:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa97756ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.235046:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa97756ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.237891:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1e00/0x70647b5fa97756f5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.237912:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1e00/0x70647b5fa97756f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.237921:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1e00/0x70647b5fa97756f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790884.237931:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787790884.238211:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa97756e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.238220:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa97756e7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.238228:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa97756e7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.238242:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f0200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790884.238248:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa97756e7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.238255:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa97756e7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.241116:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff931a4b7e7500) 00010000:00010000:1.0:1787790884.241128:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790884.241140:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa97756e7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.241150:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa97756e7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.241179:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa97756ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.241186:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa97756ee lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.241192:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa97756ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.241197:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f1400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790884.241202:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa97756ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.241209:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa97756ee lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.241245:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff931a45fe6d00) 00010000:00010000:1.0:1787790884.241247:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790884.241250:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa97756ee lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.241256:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa97756ee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.241967:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa97756e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eef8 expref: 10 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.241985:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1e00/0x70647b5fa97756f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eef8 expref: 9 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.241993:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff931a45fe6e00) 00010000:00010000:1.0:1787790884.241996:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790884.241998:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f1e00, rc 0) 00000100:00100000:1.0:1787790884.242093:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+9:14422:x1874634236607104:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 7312us (7613us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787790884.242103:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:3.0:1787790884.246003:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790884.246140:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236607232 00000100:00100000:1.0:1787790884.246152:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236607232 00000100:00100000:1.0:1787790884.246225:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:1.0:1787790884.246236:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d95b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+9:14422:x1874634236607232:12345-192.168.201.25@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787790884.246369:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d95b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+9:14422:x1874634236607232:12345-192.168.201.25@tcp:59:lhsmtool_posix.0 Request processed in 135us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790884.246379:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:2.0:1787790884.258625:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790884.258768:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236607360 00000100:00100000:1.0:1787790884.258779:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236607360 00000100:00100000:1.0:1787790884.258846:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:1.0:1787790884.258858:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+9:14428:x1874634236607360:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1787790884.258882:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790884.258913:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa9775703 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496eeff expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.258992:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa977570a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259008:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa977570a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259020:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa977570a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259034:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775711 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259041:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259048:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259338:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa977570a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259346:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa977570a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259364:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa977570a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259370:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f1400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790884.259375:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa977570a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259385:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa977570a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259398:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a543e4700) 00010000:00010000:1.0:1787790884.259401:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790884.259407:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa977570a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259414:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa977570a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259428:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259435:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775711 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259440:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775711 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259445:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f0200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790884.259448:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775711 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259464:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775711 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259472:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff931a45fe6d00) 00010000:00010000:1.0:1787790884.259475:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790884.259478:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775711 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259483:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775711 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259517:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa9775703 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eeff expref: 10 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259528:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a543e4700) 00010000:00010000:1.0:1787790884.259531:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790884.259534:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa9775703 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eeff expref: 10 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.259544:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f0600, rc 0) 00000100:00100000:1.0:1787790884.259763:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+9:14428:x1874634236607360:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 907us (1149us total) trans 0 rc 301/301 00000100:00100000:1.0:1787790884.259771:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:3.0:1787790884.266945:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790884.272517:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236607488 00000100:00100000:2.0:1787790884.272540:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236607488 00000100:00100000:2.0:1787790884.273000:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:2.0:1787790884.273014:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d959a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+9:14428:x1874634236607488:12345-192.168.201.25@tcp:700:lfs.0 00000100:00100000:2.0:1787790884.273330:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d959a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+9:14428:x1874634236607488:12345-192.168.201.25@tcp:700:lfs.0 Request processed in 319us (6396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790884.273340:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:3.0:1787790884.279634:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790884.279999:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236607744 00000100:00100000:1.0:1787790884.280010:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236607744 00000100:00100000:1.0:1787790884.280086:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:1.0:1787790884.280097:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d95a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+9:14428:x1874634236607744:12345-192.168.201.25@tcp:36:lfs.0 00010000:00010000:1.0:1787790884.280176:0:14413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790884.280206:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67980e00/0x70647b5fa9775646 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ee7a expref: 9 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.280227:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a543e4700) 00010000:00010000:1.0:1787790884.280232:0:14413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790884.280529:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775718 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.280544:0:14413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977567e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496eedc expref: 5 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.280553:0:14413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775718 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.280591:0:14413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977567e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eedc expref: 5 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.280607:0:14413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977567e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eedc expref: 5 pid: 15693 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790884.280630:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8119bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14413:1874634253373056:192.168.201.25@tcp:104: 00000100:00100000:1.0:1787790884.280767:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67cd1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787790884.285247:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790884.285373:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8119bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14413:1874634253373056:192.168.201.25@tcp:104: 00010000:00010000:3.0:1787790884.285441:0:14413:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775718 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790884.287149:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236607872 00000100:00100000:2.0:1787790884.287163:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236607872 00010000:00010000:2.0:1787790884.287286:0:14399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977567e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eedc expref: 6 pid: 15693 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790884.287337:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:2.0:1787790884.287348:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81199e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+6:2349:x1874634236607872:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790884.287382:0:14399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790884.287390:0:14399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977567e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eedc expref: 6 pid: 15693 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.287405:0:14399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977567e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eedc expref: 6 pid: 15693 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.287434:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa977567e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496eedc expref: 6 pid: 15693 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.287452:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a543e4700) 00010000:00010000:2.0:1787790884.287458:0:14399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775718 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.287468:0:14399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775718 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.287477:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775718 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.287520:0:14399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790884.287580:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81199e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+5:2349:x1874634236607872:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 233us (2340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790884.287587:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00010000:00010000:0.0:1787790884.287834:0:14413:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775718 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.287843:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775718 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.287869:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa977571f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.287881:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa977571f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.287898:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa977571f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790884.289390:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787790884.289406:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775718 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.289413:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775718 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.289418:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775718 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.289421:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f0200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790884.289431:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775718 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.289436:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775718 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.289449:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a543e4700) 00010000:00010000:0.0:1787790884.289451:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790884.289455:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775718 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.289459:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa9775718 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790884.289476:0:14413:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f07c7d54 reply state 000000004c44e5b1 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa977571f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790884.289483:0:14413:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787790884.289580:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d95a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+10:14428:x1874634236607744:12345-192.168.201.25@tcp:36:lfs.0 Request processed in 9481us (9951us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787790884.289589:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00080000:1.0:1787790884.293676:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787790884.299608:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa977571f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790884.299629:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa977571f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790884.299637:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa977571f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790884.299643:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790884.299648:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa977571f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790884.299674:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa977571f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790884.299697:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff931a543e4f00) 00010000:00010000:3.0:1787790884.299700:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790884.299706:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa977571f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790884.299712:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa977571f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790884.444316:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790884.444481:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236608000 00000100:00100000:1.0:1787790884.444494:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236608000 00000100:00100000:1.0:1787790884.444582:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:1.0:1787790884.445131:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+9:14436:x1874634236608000:12345-192.168.201.25@tcp:101:lctl.0 00010000:00010000:1.0:1787790884.445189:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790884.445226:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa9775726 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef06 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.445319:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0000/0x70647b5fa977572d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.445338:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0000/0x70647b5fa977572d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.445354:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0000/0x70647b5fa977572d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790884.445498:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787790884.445502:0:14411:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787790884.445568:0:14411:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0000/0x70647b5fa977572d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.447020:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa9775726 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef06 expref: 11 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.447061:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0000/0x70647b5fa977572d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef06 expref: 10 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.447072:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a45fe6d00) 00010000:00010000:1.0:1787790884.447076:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787790884.447079:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f0000, rc 0) 00000100:00100000:1.0:1787790884.447176:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+10:14436:x1874634236608000:12345-192.168.201.25@tcp:101:lctl.0 Request processed in 2584us (2876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790884.447187:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:1.0:1787790884.483061:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790884.483178:0:15693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236608128 00000100:00100000:2.0:1787790884.483197:0:15693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236608128 00000100:00100000:2.0:1787790884.483276:0:15693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:2.0:1787790884.483288:0:15693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81198f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+5:14437:x1874634236608128:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1787790884.483347:0:15693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790884.483377:0:15693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa9775734 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef0d expref: -99 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.483474:0:15693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa977573b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.483491:0:15693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa977573b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.483505:0:15693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa977573b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790884.483950:0:15693:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787790884.483956:0:15693:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787790884.484067:0:15693:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa977573b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.484106:0:15693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa9775734 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef0d expref: 7 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.484131:0:15693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fc00/0x70647b5fa977573b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef0d expref: 6 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.484140:0:15693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a45fe6d00) 00010000:00010000:2.0:1787790884.484144:0:15693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790884.484148:0:15693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654fc00, rc 0) 00000100:00100000:2.0:1787790884.484228:0:15693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81198f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+6:14437:x1874634236608128:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 942us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790884.484237:0:15693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:2.0:1787790884.487491:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790884.487644:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236608256 00000100:00100000:1.0:1787790884.487657:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236608256 00000100:00100000:1.0:1787790884.487760:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:1.0:1787790884.487771:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+6:14437:x1874634236608256:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1787790884.487799:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790884.487823:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa9775742 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef14 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488116:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa9775749 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488134:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa9775749 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488148:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa9775749 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488165:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa9775750 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488172:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa9775750 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488179:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa9775750 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488506:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa9775757 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488531:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa9775757 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488558:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa9775757 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790884.488629:0:14412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787790884.488633:0:14412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787790884.488659:0:14412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa9775757 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488674:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa9775749 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488680:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa9775749 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488688:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa9775749 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488694:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f1600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790884.488700:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa9775749 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488707:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa9775749 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488719:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a45fe6d00) 00010000:00010000:1.0:1787790884.488765:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790884.488772:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa9775749 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488779:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa9775749 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488807:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa9775750 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488813:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa9775750 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488819:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa9775750 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488824:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f0e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790884.488828:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa9775750 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488834:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa9775750 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488841:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff931a45fe6800) 00010000:00010000:1.0:1787790884.488843:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790884.488846:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa9775750 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488853:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa9775750 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488915:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa9775742 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef14 expref: 8 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488931:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa9775757 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef14 expref: 7 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.488951:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff931a45fe6700) 00010000:00010000:1.0:1787790884.488954:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787790884.488957:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f0400, rc 0) 00000100:00100000:1.0:1787790884.489067:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+7:14437:x1874634236608256:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1296us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790884.489078:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:2.0:1787790884.494032:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790884.494136:0:15693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236608512 00000100:00100000:3.0:1787790884.494150:0:15693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236608512 00000100:00100000:3.0:1787790884.494230:0:15693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:3.0:1787790884.494241:0:15693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+7:14437:x1874634236608512:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1787790884.494270:0:15693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790884.494295:0:15693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa977575e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef1b expref: -99 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790884.494456:0:15693:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787790884.494639:0:15693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa977575e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef1b expref: 9 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790884.494657:0:15693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a45fe6d00) 00010000:00010000:3.0:1787790884.494661:0:15693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787790884.494667:0:15693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa977575e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef1b expref: 9 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790884.494703:0:15693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153600, rc 0) 00000100:00100000:3.0:1787790884.494801:0:15693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+8:14437:x1874634236608512:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 562us (784us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1787790884.494810:0:15693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:2.0:1787790884.497895:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790884.498084:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236608768 00000100:00100000:1.0:1787790884.498096:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236608768 00000100:00100000:1.0:1787790884.498152:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:1.0:1787790884.498162:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+8:14437:x1874634236608768:12345-192.168.201.25@tcp:36:lfs.0 00010000:00010000:1.0:1787790884.498230:0:14411:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790884.498261:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa9775757 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef14 expref: 8 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.498287:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff931a45fe6700) 00010000:00010000:1.0:1787790884.498300:0:14411:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790884.498341:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0800/0x70647b5fa977576c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.498359:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0800/0x70647b5fa977576c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.498372:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0800/0x70647b5fa977576c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790884.498669:0:14411:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8d7cc02 reply state 000000002e6028fe transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0800/0x70647b5fa977576c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790884.498700:0:14411:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787790884.498716:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1787790884.499107:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+9:14437:x1874634236608768:12345-192.168.201.25@tcp:36:lfs.0 Request processed in 944us (1224us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787790884.499116:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 24 00010000:00010000:1.0:1787790884.501527:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0800/0x70647b5fa977576c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.501548:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0800/0x70647b5fa977576c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.501557:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0800/0x70647b5fa977576c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.501564:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f0800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790884.501570:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0800/0x70647b5fa977576c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.501580:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0800/0x70647b5fa977576c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.501598:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff931a45fe6a00) 00010000:00010000:1.0:1787790884.501602:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787790884.501618:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0800/0x70647b5fa977576c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.501626:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0800/0x70647b5fa977576c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790884.502427:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790884.503104:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236609024 00000100:00100000:1.0:1787790884.503135:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236609024 00000100:00100000:1.0:1787790884.503189:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:1.0:1787790884.503199:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+8:14437:x1874634236609024:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:1.0:1787790884.503625:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+9:14437:x1874634236609024:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 425us (1204us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787790884.503635:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:3.0:1787790884.506820:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790884.506924:0:15693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236609280 00000100:00100000:0.0:1787790884.506935:0:15693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236609280 00000100:00100000:0.0:1787790884.507015:0:15693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:0.0:1787790884.507027:0:15693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d95bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+9:14437:x1874634236609280:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1787790884.507065:0:15693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790884.507092:0:15693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9775773 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef22 expref: -99 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507184:0:15693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977577a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507218:0:15693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977577a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507232:0:15693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977577a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507250:0:15693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775781 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507258:0:15693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775781 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507265:0:15693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775781 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790884.507439:0:15693:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787790884.507565:0:15693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977577a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507574:0:15693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977577a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507582:0:15693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977577a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507589:0:15693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790884.507594:0:15693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977577a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507603:0:15693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977577a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507634:0:15693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a45fe6d00) 00010000:00010000:0.0:1787790884.507637:0:15693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790884.507643:0:15693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977577a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507650:0:15693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa977577a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507664:0:15693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775781 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507670:0:15693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775781 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507675:0:15693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775781 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507680:0:15693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790884.507684:0:15693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775781 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507690:0:15693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775781 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507697:0:15693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff931a543e4700) 00010000:00010000:0.0:1787790884.507699:0:15693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790884.507702:0:15693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775781 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507708:0:15693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775781 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507785:0:15693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9775773 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef22 expref: 11 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507798:0:15693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a45fe6d00) 00010000:00010000:0.0:1787790884.507801:0:15693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787790884.507805:0:15693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa9775773 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef22 expref: 11 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.507816:0:15693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981400, rc 0) 00000100:00100000:0.0:1787790884.508571:0:15693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d95bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+10:14437:x1874634236609280:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1542us (1759us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787790884.508583:0:15693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:3.0:1787790884.514105:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790884.514229:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236609408 00000100:00100000:2.0:1787790884.514242:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236609408 00000100:00100000:2.0:1787790884.514378:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:2.0:1787790884.514391:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d95b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+10:14437:x1874634236609408:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1787790884.514428:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790884.514458:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa977578f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef29 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.514819:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9775796 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.514839:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9775796 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.514854:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9775796 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790884.515088:0:14412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787790884.515093:0:14412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787790884.515122:0:14412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9775796 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.515157:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa977578f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef29 expref: 12 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.515178:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9775796 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef29 expref: 11 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.515207:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff931a4b7e7e00) 00010000:00010000:2.0:1787790884.515210:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790884.515214:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a4654fe00, rc 0) 00000100:00100000:2.0:1787790884.515530:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d95b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+11:14437:x1874634236609408:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1141us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790884.515539:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:2.0:1787790884.519299:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790884.519387:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236609536 00000100:00100000:1.0:1787790884.519399:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236609536 00000100:00100000:1.0:1787790884.519489:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:1.0:1787790884.519500:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+11:14437:x1874634236609536:12345-192.168.201.25@tcp:37:lfs.0 00000100:00100000:2.0:1787790884.525513:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+11:14437:x1874634236609536:12345-192.168.201.25@tcp:37:lfs.0 Request processed in 5997us (6209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790884.525531:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:0.0:1787790884.529880:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790884.530162:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236609792 00000100:00100000:2.0:1787790884.530177:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236609792 00000100:00100000:2.0:1787790884.530243:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:2.0:1787790884.530255:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d5ca850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+11:14437:x1874634236609792:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1787790884.530700:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d5ca850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+12:14437:x1874634236609792:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 445us (849us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787790884.530710:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:0.0:1787790884.589958:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790884.590097:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236609920 00000100:00100000:1.0:1787790884.590111:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236609920 00000100:00100000:1.0:1787790884.590186:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:1.0:1787790884.590197:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+10:14443:x1874634236609920:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1787790884.590225:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790884.590253:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa977579d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef30 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590349:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa97757a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590370:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa97757a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590384:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa97757a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590402:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa97757ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590429:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa97757ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590437:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa97757ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590600:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0800/0x70647b5fa97757b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590620:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0800/0x70647b5fa97757b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590629:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0800/0x70647b5fa97757b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790884.590667:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787790884.590672:0:14413:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787790884.590780:0:14413:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0800/0x70647b5fa97757b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590796:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa97757a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590803:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa97757a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590812:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa97757a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590820:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f0e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790884.590826:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa97757a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590841:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa97757a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590857:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a45fe6d00) 00010000:00010000:1.0:1787790884.590861:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790884.590866:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa97757a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590874:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa97757a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590894:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa97757ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590901:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa97757ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590907:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa97757ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590913:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f1600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790884.590916:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa97757ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590922:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa97757ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590929:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff931a45fe6a00) 00010000:00010000:1.0:1787790884.590931:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790884.590934:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa97757ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590949:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa97757ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.590987:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa977579d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef30 expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.591003:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0800/0x70647b5fa97757b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef30 expref: 11 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.591011:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff931a4b7e7e00) 00010000:00010000:1.0:1787790884.591014:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787790884.591016:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f0800, rc 0) 00000100:00100000:1.0:1787790884.591101:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+11:14443:x1874634236609920:12345-192.168.201.25@tcp:101:bash.0 Request processed in 905us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790884.591110:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:1.0:1787790884.595421:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790884.598200:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236610176 00000100:00100000:2.0:1787790884.598216:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236610176 00000100:00100000:2.0:1787790884.598309:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:2.0:1787790884.598321:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+11:14443:x1874634236610176:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:2.0:1787790884.598353:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790884.598383:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa97757b9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef37 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.598605:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97757c0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.598624:0:14411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9775796 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef29 expref: 11 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.598635:0:14411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97757c0 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.598685:0:14411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9775796 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef29 expref: 11 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.598704:0:14411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9775796 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef29 expref: 11 pid: 14412 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790884.598883:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7db6a580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14411:1874634253373184:192.168.201.25@tcp:104: 00000100:00100000:2.0:1787790884.599222:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67d4bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787790884.605258:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7db6a580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14411:1874634253373184:192.168.201.25@tcp:104: 00010000:00010000:1.0:1787790884.605304:0:14411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97757c0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790884.607384:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790884.607655:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236610304 00000100:00100000:2.0:1787790884.607667:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236610304 00010000:00010000:2.0:1787790884.607721:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9775796 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef29 expref: 12 pid: 14412 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790884.607815:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:2.0:1787790884.607826:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d958b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+12:2348:x1874634236610304:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790884.607847:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790884.607866:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9775796 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef29 expref: 12 pid: 14412 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.607902:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9775796 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef29 expref: 12 pid: 14412 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.607931:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654fe00/0x70647b5fa9775796 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef29 expref: 12 pid: 14412 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.607950:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff931a4b7e7e00) 00010000:00010000:2.0:1787790884.607956:0:14397:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97757c0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.607967:0:14397:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97757c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.607977:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97757c0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.608009:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790884.608096:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d958b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+11:2348:x1874634236610304:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 270us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790884.608105:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00010000:00010000:0.0:1787790884.608482:0:14411:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97757c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.608493:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97757c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.608527:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.608539:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.608548:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.609656:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa97757ce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.609669:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa97757ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.609678:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa97757ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790884.609691:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787790884.609749:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97757c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.609758:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97757c0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.609768:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97757c0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.609776:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a4654ee00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787790884.609781:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97757c0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.609791:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97757c0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.609804:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff931a4b7e7e00) 00010000:00010000:0.0:1787790884.609807:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790884.609812:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97757c0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.609832:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654ee00/0x70647b5fa97757c0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790884.609847:0:14411:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed72a2c3 reply state 000000004086c7a4 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790884.610227:0:14411:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787790884.610277:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a4654f400/0x70647b5fa97757b9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef37 expref: 14 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.610294:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa97757ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef37 expref: 13 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.610303:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff931a543e4100) 00010000:00010000:0.0:1787790884.610305:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1787790884.610308:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981800, rc 0) 00000100:00100000:0.0:1787790884.610503:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+14:14443:x1874634236610176:12345-192.168.201.25@tcp:101:bash.0 Request processed in 12182us (15099us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787790884.610513:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 28 00010000:00010000:1.0:1787790884.613776:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.613806:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757c7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.613816:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.613846:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790884.613852:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.613871:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757c7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.613896:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff931a543e4700) 00010000:00010000:1.0:1787790884.613899:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790884.613904:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757c7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.613913:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757c7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790884.629712:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790884.630476:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236610432 00000100:00100000:1.0:1787790884.630491:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236610432 00000100:00100000:0.0:1787790884.631146:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 29 00000100:00100000:0.0:1787790884.631159:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+13:14443:x1874634236610432:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:0.0:1787790884.631192:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790884.631222:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981600/0x70647b5fa97757dc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef3e expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.631596:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.631689:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.631703:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790884.632072:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787790884.632078:0:14413:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787790884.632102:0:14413:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.632115:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.632150:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981600/0x70647b5fa97757dc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef3e expref: 15 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.632177:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef3e expref: 14 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.632188:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff931a543e4100) 00010000:00010000:0.0:1787790884.632191:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790884.632195:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981c00, rc 0) 00000100:00100000:0.0:1787790884.632428:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+14:14443:x1874634236610432:12345-192.168.201.25@tcp:101:bash.0 Request processed in 1270us (2735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790884.632438:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 29 00000100:00100000:3.0:1787790884.636210:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790884.636295:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236610688 00000100:00100000:2.0:1787790884.636308:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236610688 00000100:00100000:2.0:1787790884.636424:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:2.0:1787790884.636435:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d95a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+14:14443:x1874634236610688:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:2.0:1787790884.636978:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d95a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+15:14443:x1874634236610688:12345-192.168.201.25@tcp:35:bash.0 Request processed in 543us (781us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787790884.637008:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:2.0:1787790884.735828:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790884.735995:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236610944 00000100:00100000:1.0:1787790884.736008:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236610944 00000100:00100000:1.0:1787790884.736077:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 30 00000100:00100000:1.0:1787790884.736087:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+15:14453:x1874634236610944:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1787790884.736118:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790884.736143:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa97757ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef45 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790884.736333:0:14412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787790884.736475:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa97757ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef45 expref: 17 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.736504:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff931a45fe6d00) 00010000:00010000:1.0:1787790884.736507:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787790884.736512:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa97757ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef45 expref: 17 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.736539:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f0400, rc 0) 00000100:00100000:1.0:1787790884.736614:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+16:14453:x1874634236610944:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 527us (802us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787790884.736622:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 30 00000100:00100000:3.0:1787790884.742378:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790884.742659:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236611200 00000100:00100000:0.0:1787790884.742673:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236611200 00000100:00100000:0.0:1787790884.742781:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:0.0:1787790884.742812:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d958f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+16:14453:x1874634236611200:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:0.0:1787790884.743222:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d958f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+17:14453:x1874634236611200:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 412us (857us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787790884.743231:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:3.0:1787790884.784185:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790884.784529:0:15693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236611456 00000100:00100000:0.0:1787790884.784542:0:15693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236611456 00000100:00100000:0.0:1787790884.784787:0:15693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:0.0:1787790884.784801:0:15693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d9592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+17:14456:x1874634236611456:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1787790884.784845:0:15693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790884.784890:0:15693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981600/0x70647b5fa97757f8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef4c expref: -99 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.785014:0:15693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa97757ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.785031:0:15693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa97757ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.785054:0:15693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa97757ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790884.785068:0:15693:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787790884.785235:0:15693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981600/0x70647b5fa97757f8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef4c expref: 20 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.785259:0:15693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa97757ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef4c expref: 19 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790884.785294:0:15693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff931a543e4100) 00010000:00010000:0.0:1787790884.785297:0:15693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790884.785302:0:15693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981400, rc 0) 00000100:00100000:0.0:1787790884.785587:0:15693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d9592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+19:14456:x1874634236611456:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 789us (1418us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787790884.785596:0:15693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:3.0:1787790884.789371:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790884.789422:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790884.789541:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236611584 00000100:00100000:1.0:1787790884.789553:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236611584 00000100:00100000:1.0:1787790884.789631:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:1.0:1787790884.789642:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+19:14456:x1874634236611584:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:1.0:1787790884.789762:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa977580d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.789783:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa977580d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.789796:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa977580d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.789832:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa977580d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.789841:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa977580d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.789869:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa977580d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.789877:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f0400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790884.789894:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa977580d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.789904:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa977580d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.789920:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff931a543e4100) 00010000:00010000:1.0:1787790884.789923:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787790884.789928:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa977580d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.789935:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa977580d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790884.790030:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+19:14456:x1874634236611584:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 389us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790884.790039:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:2.0:1787790884.790613:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236611712 00000100:00100000:2.0:1787790884.790620:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236611712 00000100:00100000:2.0:1787790884.790668:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:2.0:1787790884.790677:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d95a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+19:2348:x1874634236611712:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790884.790691:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790884.790710:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa97757ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef4c expref: 19 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790884.790754:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff931a543e4100) 00010000:00010000:2.0:1787790884.790759:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790884.790796:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d95a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+18:2348:x1874634236611712:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 121us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790884.790804:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:3.0:1787790884.792433:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790884.792871:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236611968 00000100:00100000:2.0:1787790884.792891:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236611968 00000100:00100000:2.0:1787790884.792944:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:2.0:1787790884.792954:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d95ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+18:14456:x1874634236611968:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1787790884.793249:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d95ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+19:14456:x1874634236611968:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 295us (825us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787790884.793258:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00010000:00010000:2.0:1787790884.992105:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790884.993251:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790884.993341:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236612224 00000100:00100000:1.0:1787790884.993353:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236612224 00000100:00100000:1.0:1787790884.993480:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:1.0:1787790884.993490:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d959680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+19:14487:x1874634236612224:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:1.0:1787790884.993522:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790884.993551:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa9775814 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef53 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.993764:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa977581b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.993782:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa977581b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.993792:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa977581b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790884.993804:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787790884.994083:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa9775814 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef53 expref: 22 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.994106:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa977581b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef53 expref: 21 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790884.994114:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff931a543e4100) 00010000:00010000:1.0:1787790884.994116:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787790884.994119:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f1600, rc 0) 00000100:00100000:1.0:1787790884.994266:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d959680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+21:14487:x1874634236612224:12345-192.168.201.25@tcp:101:cat.0 Request processed in 778us (1023us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1787790884.994271:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:1.0:1787790884.996883:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790884.997120:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236612352 00000100:00100000:3.0:1787790884.997130:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236612352 00000100:00100000:3.0:1787790884.997195:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:3.0:1787790884.997203:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+21:2348:x1874634236612352:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790884.997218:0:14399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790884.997241:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa977581b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef53 expref: 21 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790884.997258:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff931a543e4100) 00010000:00010000:3.0:1787790884.997263:0:14399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790884.997316:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+20:2348:x1874634236612352:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 113us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790884.997342:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:2.0:1787790884.997581:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790884.997879:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236612608 00000100:00100000:0.0:1787790884.997883:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236612608 00000100:00100000:0.0:1787790884.997930:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:0.0:1787790884.997938:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+20:14487:x1874634236612608:12345-192.168.201.25@tcp:35:cat.0 00000100:00100000:0.0:1787790884.998485:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+21:14487:x1874634236612608:12345-192.168.201.25@tcp:35:cat.0 Request processed in 546us (902us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787790884.998491:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:2.0:1787790885.052453:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.059483:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236612864 00000100:00100000:1.0:1787790885.060160:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236612864 00000100:00100000:1.0:1787790885.060427:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 34 00000100:00100000:1.0:1787790885.060441:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+21:14493:x1874634236612864:12345-192.168.201.25@tcp:101:dd.0 00010000:00010000:1.0:1787790885.060496:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790885.061540:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa9775829 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef5a expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.061823:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa9775830 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.061845:0:14412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa97757ce lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef37 expref: 22 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.061855:0:14412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757e3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef3e expref: 22 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.061863:0:14412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa9775830 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.061925:0:14412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef3e expref: 22 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.061944:0:14412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef3e expref: 22 pid: 14413 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790885.061961:0:14412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8119a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14412:1874634253373312:192.168.201.25@tcp:104: 00010000:00010000:1.0:1787790885.062484:0:14412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa97757ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef37 expref: 22 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.062495:0:14412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa97757ce lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef37 expref: 22 pid: 14411 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790885.062637:0:14412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8119bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14412:1874634253373440:192.168.201.25@tcp:104: 00000100:00100000:1.0:1787790885.062667:0:14412:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67cd1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790885.071478:0:14412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8119a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14412:1874634253373312:192.168.201.25@tcp:104: 00000100:00100000:1.0:1787790885.071702:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790885.071765:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236612992 00000100:00100000:3.0:1787790885.071775:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236612992 00000100:00100000:1.0:1787790885.071779:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00010000:00010000:3.0:1787790885.071845:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef3e expref: 23 pid: 14413 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790885.071861:0:14412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8119bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14412:1874634253373440:192.168.201.25@tcp:104: 00010000:00010000:2.0:1787790885.071909:0:14412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa9775830 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790885.071911:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236613120 00000100:00100000:3.0:1787790885.071915:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236613120 00010000:00010000:3.0:1787790885.071929:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa97757ce lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef37 expref: 24 pid: 14411 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790885.071956:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:3.0:1787790885.071968:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+24:2349:x1874634236612992:12345-192.168.201.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787790885.072166:0:14398:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787790885.072177:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1787790885.072600:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790885.072611:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef3e expref: 24 pid: 14413 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.072626:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef3e expref: 24 pid: 14413 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.072655:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97757e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef3e expref: 24 pid: 14413 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.072673:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff931a543e4100) 00010000:00010000:3.0:1787790885.072679:0:14397:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa9775830 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.072711:0:14397:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa9775830 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.072719:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790885.072867:0:14399:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787790885.072883:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:0.0:1787790885.072894:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81198780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+23:2349:x1874634236613120:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790885.072968:0:14399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790885.072975:0:14399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa97757ce lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef37 expref: 23 pid: 14411 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.072986:0:14399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa97757ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef37 expref: 23 pid: 14411 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.072999:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa97757ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef37 expref: 23 pid: 14411 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.073017:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff931a543e4100) 00010000:00010000:0.0:1787790885.073021:0:14399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa9775830 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.073029:0:14399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa9775830 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.073104:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa9775830 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.073131:0:14399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790885.073173:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+22:2349:x1874634236612992:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 1206us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790885.073183:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00010000:00010000:3.0:1787790885.073263:0:14412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa9775830 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.073271:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa9775830 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790885.073294:0:14412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000100:00100000:0.0:1787790885.073470:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81198780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+22:2349:x1874634236613120:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 578us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790885.073477:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00010000:00010000:3.0:1787790885.073511:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa9775829 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef5a expref: 22 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.073532:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0e00/0x70647b5fa9775830 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef5a expref: 21 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.073540:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff931a543e4100) 00010000:00010000:3.0:1787790885.073542:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787790885.073545:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f0e00, rc 0) 00000100:00100000:3.0:1787790885.073572:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+21:14493:x1874634236612864:12345-192.168.201.25@tcp:101:dd.0 Request processed in 13135us (21182us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1787790885.073579:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 34 00000100:00100000:1.0:1787790885.080358:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790885.081489:0:15693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236613376 00000100:00100000:3.0:1787790885.081510:0:15693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236613376 00000100:00100000:1.0:1787790885.082118:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:1.0:1787790885.082135:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81199680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+21:14493:x1874634236613376:12345-192.168.201.25@tcp:36:dd.0 00010000:00010000:1.0:1787790885.086107:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa977583e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.086140:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa977583e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.086155:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa977583e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787790885.086268:0:14413:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1787790885.086313:0:14413:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a4fb62a reply state 000000009eb849bd transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa977583e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790885.086324:0:14413:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787790885.087196:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81199680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+24:14493:x1874634236613376:12345-192.168.201.25@tcp:36:dd.0 Request processed in 5059us (6845us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1787790885.087208:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 35 00000020:00080000:1.0:1787790885.087216:0:14413:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787790885.089370:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa977583e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790885.089392:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa977583e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790885.090163:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.090263:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236613504 00000100:00100000:1.0:1787790885.090275:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236613504 00000100:00100000:1.0:1787790885.090352:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:1.0:1787790885.090364:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+24:14493:x1874634236613504:12345-192.168.201.25@tcp:101:dd.0 00010000:00010000:1.0:1787790885.090397:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790885.090423:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa9775845 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef61 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.090526:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa9775845 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef61 expref: 25 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.090547:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa9775845 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef61 expref: 25 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.090584:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff931a543e4100) 00010000:00010000:1.0:1787790885.090588:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787790885.090593:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f1200, rc 0) 00000100:00100000:1.0:1787790885.090685:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+25:14493:x1874634236613504:12345-192.168.201.25@tcp:101:dd.0 Request processed in 323us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790885.090694:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 36 00010000:00010000:2.0:1787790885.093214:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa977583e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790885.093241:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f0200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787790885.093248:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa977583e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790885.093261:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa977583e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790885.093283:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff931a543e4100) 00010000:00010000:2.0:1787790885.093287:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790885.093294:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa977583e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790885.093302:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa977583e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790885.113476:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790885.113782:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236613760 00000100:00100000:3.0:1787790885.113796:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236613760 00000100:00100000:3.0:1787790885.113895:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:3.0:1787790885.113917:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a81199e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+24:14493:x1874634236613760:12345-192.168.201.25@tcp:103:dd.0 00010000:00010000:3.0:1787790885.114123:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790885.114160:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa9775845 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef61 expref: 24 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.114187:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff931a543e4100) 00010000:00010000:3.0:1787790885.114194:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790885.114278:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a81199e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+23:14493:x1874634236613760:12345-192.168.201.25@tcp:103:dd.0 Request processed in 364us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790885.114288:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:0.0:1787790885.120138:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790885.120663:0:15693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236613888 00000100:00100000:3.0:1787790885.120675:0:15693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236613888 00000100:00100000:3.0:1787790885.120824:0:15693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00100000:3.0:1787790885.120836:0:15693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+23:14493:x1874634236613888:12345-192.168.201.25@tcp:58:dd.0 00010000:00010000:3.0:1787790885.121010:0:15693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa977584c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.121045:0:15693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa977584c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.121063:0:15693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa977584c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787790885.122030:0:15693:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787790885.122236:0:15693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1787790885.122324:0:15693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1787790885.122514:0:15693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+23:14493:x1874634236613888:12345-192.168.201.25@tcp:58:dd.0 Request processed in 1675us (3106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790885.122528:0:15693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00100000:0.0:1787790885.141682:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.144145:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236614016 00000100:00100000:1.0:1787790885.144165:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236614016 00000100:00100000:1.0:1787790885.144265:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:1.0:1787790885.144278:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+23:14493:x1874634236614016:12345-192.168.201.25@tcp:101:dd.0 00010000:00010000:1.0:1787790885.144308:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790885.144339:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa9775853 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef68 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.144468:0:14411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa977584c lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.144482:0:14411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa9775853 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef68 expref: 24 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.144521:0:14411:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa977584c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.144538:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa9775853 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef68 expref: 24 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.144554:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff931a543e4100) 00010000:00010000:1.0:1787790885.144558:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787790885.144563:0:14411:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa9775853 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef68 expref: 24 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.144572:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f0600, rc 0) 00000100:00100000:1.0:1787790885.144669:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+24:14493:x1874634236614016:12345-192.168.201.25@tcp:101:dd.0 Request processed in 393us (2999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790885.144677:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 38 00000040:00080000:0.0:1787790885.249352:0:14444:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787790885.249366:0:14444:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787790885.250714:0:14444:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787790885.250997:0:14444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787790885.252304:0:14444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a7be1b840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14444:1874634253373568:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787790885.252441:0:14444:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a42f600c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790885.258293:0:14444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a7be1b840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14444:1874634253373568:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787790885.262576:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790885.262782:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236614144 00000100:00100000:2.0:1787790885.262794:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236614144 00000100:00100000:2.0:1787790885.262906:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:2.0:1787790885.262917:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+24:14494:x1874634236614144:12345-192.168.201.25@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787790885.263212:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+24:14494:x1874634236614144:12345-192.168.201.25@tcp:900:lhsmtool_posix.0 Request processed in 115us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790885.263221:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:0.0:1787790885.265355:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.265521:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236614272 00000100:00100000:1.0:1787790885.265537:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236614272 00000100:00100000:1.0:1787790885.265596:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:1.0:1787790885.265607:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+24:14494:x1874634236614272:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787790885.265647:0:14413:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787790885.266048:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+24:14494:x1874634236614272:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 442us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790885.266057:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:3.0:1787790885.268605:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.268687:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236614400 00000100:00100000:1.0:1787790885.268701:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236614400 00000100:00100000:3.0:1787790885.268958:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:3.0:1787790885.268986:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d95b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+24:14494:x1874634236614400:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787790885.269100:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa977585a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269123:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa977585a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269134:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa977585a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269277:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9775861 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269306:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9775861 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269319:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9775861 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269353:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9775868 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269362:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9775868 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269390:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9775868 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790885.269440:0:14412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787790885.269444:0:14412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787790885.269461:0:14412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9775868 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269475:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa977585a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269482:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa977585a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269489:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa977585a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269495:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790885.269500:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa977585a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269507:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa977585a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269521:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff931a45fe6e00) 00010000:00010000:3.0:1787790885.269525:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790885.269530:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa977585a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269536:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa977585a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269563:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9775861 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269582:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9775861 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269587:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9775861 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269592:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790885.269595:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9775861 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269600:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9775861 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269607:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff931a541ad300) 00010000:00010000:3.0:1787790885.269610:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790885.269613:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9775861 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269617:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9775861 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269633:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9775868 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269638:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9775868 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269643:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9775868 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269663:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790885.269666:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9775868 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269672:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9775868 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269681:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff931a543e4100) 00010000:00010000:3.0:1787790885.269683:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790885.269686:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9775868 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.269691:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9775868 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790885.271147:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d95b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+24:14494:x1874634236614400:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 Request processed in 2165us (2542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790885.271161:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:0.0:1787790885.275405:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790885.276152:0:15693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236614656 00000100:00100000:3.0:1787790885.276165:0:15693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236614656 00000100:00100000:3.0:1787790885.276240:0:15693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 41 00000100:00100000:3.0:1787790885.276251:0:15693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7be1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+24:14494:x1874634236614656:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787790885.276271:0:15693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790885.276293:0:15693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa977586f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef6f expref: -99 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.276394:0:15693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9775876 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.276426:0:15693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9775876 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.276437:0:15693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9775876 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790885.276450:0:15693:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787790885.276698:0:15693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9775876 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.276706:0:15693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9775876 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.276715:0:15693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9775876 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.276823:0:15693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790885.276829:0:15693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9775876 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.276838:0:15693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9775876 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.276850:0:15693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff931a543e4100) 00010000:00010000:3.0:1787790885.276853:0:15693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787790885.276858:0:15693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9775876 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.276864:0:15693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa9775876 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.277105:0:15693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa977586f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef6f expref: 26 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.277125:0:15693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff931a45fe6e00) 00010000:00010000:3.0:1787790885.277127:0:15693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787790885.277132:0:15693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa977586f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef6f expref: 26 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.277143:0:15693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82152200, rc 0) 00000100:00100000:3.0:1787790885.277214:0:15693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7be1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+25:14494:x1874634236614656:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 964us (1818us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1787790885.277223:0:15693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 41 00000100:00100000:0.0:1787790885.280211:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.281369:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236614784 00000100:00100000:1.0:1787790885.281538:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236614784 00000100:00100000:1.0:1787790885.281754:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:1.0:1787790885.281828:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+25:14494:x1874634236614784:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787790885.282268:0:14411:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787790885.282441:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+25:14494:x1874634236614784:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 676us (2241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790885.282451:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:2.0:1787790885.286263:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.286401:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236615040 00000100:00100000:1.0:1787790885.286417:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236615040 00000100:00100000:1.0:1787790885.286505:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:1.0:1787790885.286517:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+25:14494:x1874634236615040:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790885.286552:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790885.286584:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa9775884 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef76 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787790885.287600:0:14413:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:1.0:1787790885.287611:0:14413:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1787790885.287662:0:14413:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1787790885.289495:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa977588b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.289529:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa977588b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.289564:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa977588b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.289650:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1200/0x70647b5fa9775884 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef76 expref: 28 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.289669:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa977588b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef76 expref: 27 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.289677:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff931a45fe6a00) 00010000:00010000:1.0:1787790885.289679:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787790885.289682:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f0200, rc 0) 00000100:00100000:1.0:1787790885.291422:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+27:14494:x1874634236615040:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 4893us (5164us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1787790885.291436:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:0.0:1787790885.295589:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790885.296146:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236615296 00000100:00100000:3.0:1787790885.296158:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236615296 00000100:00100000:3.0:1787790885.296221:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:3.0:1787790885.296233:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+27:14494:x1874634236615296:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787790885.296307:0:14412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790885.296333:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0200/0x70647b5fa977588b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef76 expref: 27 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.296356:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff931a45fe6a00) 00010000:00010000:3.0:1787790885.296366:0:14412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787790885.296390:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9775899 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.296407:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9775899 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.296417:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9775899 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.296447:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97758a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7acbac6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.296453:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97758a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7acbac6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.296457:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97758a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7acbac6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.296526:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9775899 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.296532:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9775899 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.296536:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9775899 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.296540:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790885.296543:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9775899 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.296548:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9775899 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.296553:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff931a4b7e7e00) 00010000:00010000:3.0:1787790885.296555:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790885.296558:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9775899 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.296562:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152200/0x70647b5fa9775899 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.297084:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97758a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7acbac6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.297090:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97758a0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7acbac6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.297096:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97758a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7acbac6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.297101:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790885.297105:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97758a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7acbac6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.297112:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97758a0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7acbac6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.297122:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x7acbac6c (ffff931a541ad300) 00010000:00010000:3.0:1787790885.297124:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790885.297127:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97758a0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7acbac6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.297133:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97758a0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7acbac6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790885.297325:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+26:14494:x1874634236615296:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 1091us (1758us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787790885.297335:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:0.0:1787790885.301875:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790885.301971:0:15693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236615424 00000100:00100000:3.0:1787790885.301989:0:15693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236615424 00000100:00100000:3.0:1787790885.302077:0:15693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:3.0:1787790885.302110:0:15693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+26:14494:x1874634236615424:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787790885.302140:0:15693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790885.302184:0:15693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa97758a7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef7d expref: -99 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790885.302498:0:15693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa97758ae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790885.302519:0:15693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa97758ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790885.302530:0:15693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa97758ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790885.302671:0:15693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82152800/0x70647b5fa97758a7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef7d expref: 28 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790885.302697:0:15693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40030e00/0x70647b5fa97758ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef7d expref: 27 pid: 15693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790885.302708:0:15693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff931a541ad000) 00010000:00010000:2.0:1787790885.302711:0:15693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787790885.302715:0:15693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a40030e00, rc 0) 00000100:00100000:2.0:1787790885.302850:0:15693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+27:14494:x1874634236615424:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 741us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790885.302859:0:15693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:2.0:1787790885.308596:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.308905:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236615680 00000100:00100000:1.0:1787790885.308918:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236615680 00000100:00100000:3.0:1787790885.309091:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:3.0:1787790885.309116:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+27:14494:x1874634236615680:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787790885.309288:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97758b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.309314:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97758b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.309334:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97758b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787790885.310128:0:14412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1787790885.310144:0:14412:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 420190419654ns, next at 421190415813ns, rc = 0 00000004:00010000:3.0:1787790885.310279:0:14412:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d23e67e6 reply state 0000000027931e8f transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97758b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790885.310290:0:14412:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787790885.310435:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+29:14494:x1874634236615680:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 1328us (1863us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1787790885.310445:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:1.0:1787790885.319890:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00010000:00010000:3.0:1787790885.320087:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97758b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.320102:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97758b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.320124:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97758b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.320130:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787790885.320135:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97758b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.320143:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97758b5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.320159:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff931a541ad000) 00010000:00010000:3.0:1787790885.320163:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787790885.320167:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97758b5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.320173:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153a00/0x70647b5fa97758b5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790885.320497:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236615808 00000100:00100000:0.0:1787790885.320508:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236615808 00000100:00100000:0.0:1787790885.320641:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:0.0:1787790885.320716:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+28:14494:x1874634236615808:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787790885.320785:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790885.320806:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa97758bc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef84 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.320866:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa97758bc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef84 expref: 29 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.320879:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa97758bc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef84 expref: 29 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.321143:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff931a541ad000) 00010000:00010000:0.0:1787790885.321147:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787790885.321150:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981400, rc 0) 00000100:00100000:0.0:1787790885.321216:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+29:14494:x1874634236615808:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 504us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790885.321224:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:0.0:1787790885.324550:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.324855:0:15889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236615936 00000100:00100000:1.0:1787790885.324867:0:15889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236615936 00000100:00080000:3.0:1787790885.324935:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790885.325150:0:15889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:1.0:1787790885.325162:0:15889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+5:2349:x1874634236615936:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787790885.325611:0:15889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+6:2349:x1874634236615936:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 450us (1070us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787790885.325622:0:15889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:3.0:1787790885.327960:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790885.328020:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236616192 00000100:00100000:3.0:1787790885.328038:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236616192 00000100:00100000:0.0:1787790885.328718:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:0.0:1787790885.328812:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d958b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+29:14494:x1874634236616192:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787790885.329215:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d958b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+30:14494:x1874634236616192:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 412us (1267us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1787790885.329243:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:0.0:1787790885.332109:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.332224:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236616448 00000100:00100000:1.0:1787790885.332490:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236616448 00000100:00100000:1.0:1787790885.336564:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:0.0:1787790885.336916:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+30:14494:x1874634236616448:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787790885.337085:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+30:14494:x1874634236616448:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 418us (4990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790885.337094:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:1.0:1787790885.342605:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790885.344678:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236616576 00000100:00100000:0.0:1787790885.344693:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236616576 00000100:00100000:0.0:1787790885.344778:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:0.0:1787790885.344789:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a8119bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+30:14494:x1874634236616576:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787790885.344809:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790885.344832:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97758c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef8b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.345111:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa97758ca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.345125:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa97758ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.345136:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa97758ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790885.345176:0:14413:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787790885.345195:0:14413:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa97758ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.345219:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa97758c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef8b expref: 32 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.345245:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa97758ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef8b expref: 31 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.345252:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff931a541ad000) 00010000:00010000:0.0:1787790885.345256:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787790885.345259:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a67981800, rc 0) 00000100:00100000:0.0:1787790885.345328:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a8119bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+31:14494:x1874634236616576:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 542us (2733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790885.345337:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:2.0:1787790885.353138:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.353257:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236616704 00000100:00100000:1.0:1787790885.353289:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236616704 00000100:00100000:1.0:1787790885.353370:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:1.0:1787790885.353383:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+6:2346:x1874634236616704:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790885.353418:0:15095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790885.353442:0:15095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef92 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787790885.353475:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f8625, blocks: 0x1 00010000:00010000:1.0:1787790885.353501:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=420s v=(0 0) 00010000:00010000:1.0:1787790885.353505:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790885.353516:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef92 expref: 7 pid: 15095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.353536:0:15095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef92 expref: 7 pid: 15095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.353551:0:15095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a542f1400, rc 0) 00000100:00100000:1.0:1787790885.353653:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+7:2346:x1874634236616704:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 273us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790885.353662:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:3.0:1787790885.363766:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790885.364348:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236616960 00000100:00100000:2.0:1787790885.364362:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236616960 00000100:00100000:2.0:1787790885.364442:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:2.0:1787790885.364455:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d95a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+31:14494:x1874634236616960:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787790885.364607:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d95a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+31:14494:x1874634236616960:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 155us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790885.364618:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:2.0:1787790885.368322:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790885.368439:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236617088 00000100:00100000:0.0:1787790885.368456:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236617088 00000100:00100000:0.0:1787790885.368550:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:0.0:1787790885.368564:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+31:14494:x1874634236617088:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787790885.474198:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1787790885.474231:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1787790885.474283:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:3.0:1787790885.474292:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787790885.474768:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790885.474799:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a8119a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253373696:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787790885.474909:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790885.475141:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253373696 00000100:00100000:1.0:1787790885.475151:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253373696 00000100:00100000:1.0:1787790885.475237:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787790885.475256:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d958780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1874634253373696:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787790885.475506:0:15096:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787790885.475510:0:15096:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787790885.475513:0:15096:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787790885.475515:0:15096:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787790885 -> 1787790885 00002000:00010000:1.0:1787790885.475517:0:15096:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787790885.475574:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d958780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1874634253373696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 320us (663us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787790885.475582:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:1.0:1787790885.475652:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff931a8119a1c0/2, rc 0, transno 8589934595 00000100:00100000:1.0:1787790885.475658:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a8119a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1874634253373696:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1787790885.476143:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787790885.476804:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+14:14494:x1874634236617088:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 Request processed in 108234us (108490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790885.476817:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:0.0:1787790885.483278:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.484173:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236617216 00000100:00100000:1.0:1787790885.484188:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236617216 00000100:00100000:1.0:1787790885.484274:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:1.0:1787790885.484287:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+7:2349:x1874634236617216:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787790885.484693:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+7:2349:x1874634236617216:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 Request processed in 407us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790885.484704:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:0.0:1787790885.499257:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790885.505658:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236617472 00000100:00100000:2.0:1787790885.505685:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236617472 00000100:00100000:2.0:1787790885.507654:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:2.0:1787790885.507681:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+14:14494:x1874634236617472:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787790885.507775:0:14411:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790885.507818:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981800/0x70647b5fa97758ca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef8b expref: 14 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790885.507850:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff931a541ad000) 00010000:00010000:2.0:1787790885.507857:0:14411:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790885.507919:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97758d8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790885.507937:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97758d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790885.507950:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97758d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787790885.508399:0:14411:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c17bbd69 reply state 0000000027f150de transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97758d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790885.508434:0:14411:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787790885.509291:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+15:14494:x1874634236617472:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 1614us (10043us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787790885.509302:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:0.0:1787790885.513488:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00010000:00010000:1.0:1787790885.514160:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97758d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.514177:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97758d8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.514186:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97758d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.514193:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40031400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790885.514220:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97758d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.514230:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97758d8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.514257:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff931a541ad000) 00010000:00010000:1.0:1787790885.514261:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790885.514267:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97758d8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.514276:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a40031400/0x70647b5fa97758d8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790885.514435:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236617600 00000100:00100000:3.0:1787790885.514452:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236617600 00000100:00100000:3.0:1787790885.514535:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:3.0:1787790885.514550:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+7:14494:x1874634236617600:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787790885.514577:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790885.514609:0:15096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa97758df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5a022183496ef99 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.514652:0:15096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef92 expref: 8 pid: 15095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.514665:0:15096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790885.514670:0:15096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790885.514677:0:15096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa97758df lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef99 expref: 8 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.514770:0:15096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef92 expref: 8 pid: 15095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.514786:0:15096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef92 expref: 8 pid: 15095 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790885.514804:0:15096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15096:1874634253373824:192.168.201.25@tcp:104: 00000100:00100000:3.0:1787790885.517562:0:15096:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a4658ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790885.518649:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790885.518843:0:15096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15096:1874634253373824:192.168.201.25@tcp:104: 00010000:00010000:3.0:1787790885.518920:0:15096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa97758df lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef99 expref: 8 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.518950:0:15096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff931a82153a00, rc 0) 00000100:00100000:3.0:1787790885.519110:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+8:14494:x1874634236617600:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 4563us (5635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790885.519123:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:1.0:1787790885.520763:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236617728 00000100:00100000:1.0:1787790885.520784:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236617728 00010000:00010000:1.0:1787790885.520842:0:14398:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef92 expref: 8 pid: 15095 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790885.520884:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:1.0:1787790885.520906:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+8:2348:x1874634236617728:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790885.520925:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790885.520952:0:14398:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef92 expref: 8 pid: 15095 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.520968:0:14398:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef92 expref: 8 pid: 15095 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.521012:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef92 expref: 8 pid: 15095 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.521945:0:14398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790885.521950:0:14398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790885.521962:0:14398:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa97758df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef99 expref: 7 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.521984:0:14398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa97758df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef99 expref: 7 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.522069:0:14398:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa97758df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef99 expref: 7 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790885.522091:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4794f840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14398:1874634253373952:192.168.201.25@tcp:105: 00000100:00100000:1.0:1787790885.522227:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a43a1c480 going to sleep for 11 seconds 00000100:00100000:0.0:1787790885.526338:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.526895:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4794f840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14398:1874634253373952:192.168.201.25@tcp:105: 00010000:00010000:1.0:1787790885.526945:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790885.527139:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+7:2348:x1874634236617728:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 6242us (8551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790885.527155:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:0.0:1787790885.528008:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236617856 00000100:00100000:0.0:1787790885.528019:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236617856 00000100:00100000:0.0:1787790885.528101:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:0.0:1787790885.528112:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+7:2348:x1874634236617856:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787790885.528421:0:15093:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787790885.528426:0:15093:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787790885 00002000:00010000:0.0:1787790885.528429:0:15093:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787790884 00002000:00010000:0.0:1787790885.528432:0:15093:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787790885 -> 1787790885 00002000:00010000:0.0:1787790885.528434:0:15093:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787790885.528478:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+8:2348:x1874634236617856:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 368us (2157us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787790885.528486:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:0.0:1787790885.533366:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.533522:0:15889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236617984 00000100:00100000:1.0:1787790885.533545:0:15889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236617984 00000100:00100000:1.0:1787790885.533778:0:15889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:1.0:1787790885.533792:0:15889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+8:2348:x1874634236617984:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787790885.533867:0:15889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758e6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.534200:0:15889:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa97758df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef99 expref: 8 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.534212:0:15889:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790885.534217:0:15889:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787790885.534222:0:15889:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758e6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.534283:0:15889:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa97758df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef99 expref: 8 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.534301:0:15889:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa97758df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef99 expref: 8 pid: 15096 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790885.534321:0:15889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4794f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15889:1874634253374080:192.168.201.25@tcp:104: 00000100:00100000:1.0:1787790885.540135:0:15889:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a43a1c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787790885.547323:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1787790885.547455:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236618112 00000100:00100000:3.0:1787790885.547468:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236618112 00010000:00010000:3.0:1787790885.547529:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa97758df lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef99 expref: 9 pid: 15096 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790885.547584:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:3.0:1787790885.547605:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db69e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+9:2348:x1874634236618112:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790885.547627:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790885.547657:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa97758df lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef99 expref: 9 pid: 15096 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.547675:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa97758df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef99 expref: 9 pid: 15096 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.547715:0:14397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787790885.547746:0:14397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787790885.547756:0:14397:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758e6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.547800:0:14397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758e6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.547832:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790885.548236:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db69e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+9:2348:x1874634236618112:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 632us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790885.548246:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00010000:00010000:1.0:1787790885.549366:0:15889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cd6c796/0x70647b5fa97758df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef99 expref: 8 pid: 15096 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790885.549657:0:15889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4794f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15889:1874634253374080:192.168.201.25@tcp:104: 00010000:00010000:1.0:1787790885.549692:0:15889:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758e6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.549707:0:15889:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758e6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.549778:0:15889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758e6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.549819:0:15889:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758e6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.549829:0:15889:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758e6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.549838:0:15889:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.549845:0:15889:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f1400 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790885.549850:0:15889:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.549861:0:15889:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.549880:0:15889:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758e6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.549889:0:15889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0b13cc7/0x70647b5fa97758e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790885.550268:0:15889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+7:2348:x1874634236617984:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 Request processed in 16479us (16920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790885.550279:0:15889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:2.0:1787790885.554259:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.554344:0:15693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236618368 00000100:00100000:1.0:1787790885.554356:0:15693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236618368 00000100:00100000:1.0:1787790885.554431:0:15693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 53 00000100:00100000:1.0:1787790885.554443:0:15693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+14:14494:x1874634236618368:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787790885.554564:0:15693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa97758ed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.554588:0:15693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa97758ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.554602:0:15693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa97758ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.555063:0:15693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa97758f4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.555079:0:15693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa97758bc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef84 expref: 15 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.555089:0:15693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa97758f4 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.555135:0:15693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa97758bc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef84 expref: 15 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.555168:0:15693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa97758bc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef84 expref: 15 pid: 14413 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790885.555188:0:15693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4794f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15693:1874634253374208:192.168.201.25@tcp:104: 00000100:00100000:1.0:1787790885.555300:0:15693:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a43a1c480 going to sleep for 11 seconds 00000100:00100000:0.0:1787790885.558528:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790885.558622:0:16635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236618496 00000100:00100000:2.0:1787790885.558640:0:16635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236618496 00010000:00010000:2.0:1787790885.558705:0:16635:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa97758bc lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef84 expref: 16 pid: 14413 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790885.558799:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:2.0:1787790885.558814:0:16635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+16:2349:x1874634236618496:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790885.558837:0:16635:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790885.558846:0:16635:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa97758bc lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef84 expref: 16 pid: 14413 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790885.558862:0:16635:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa97758bc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef84 expref: 16 pid: 14413 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790885.558892:0:16635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff931a541ad000) 00010000:00010000:2.0:1787790885.558898:0:16635:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa97758f4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790885.558910:0:16635:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa97758f4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790885.558940:0:16635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa97758f4 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790885.558966:0:16635:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790885.559144:0:15693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981400/0x70647b5fa97758bc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef84 expref: 16 pid: 14413 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790885.559168:0:15693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4794f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15693:1874634253374208:192.168.201.25@tcp:104: 00010000:00010000:1.0:1787790885.559197:0:15693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa97758f4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.559208:0:15693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa97758f4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.559214:0:15693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa97758f4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787790885.559513:0:15693:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1787790885.559699:0:15693:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1787790885.559780:0:15693:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1787790885.559891:0:15693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4794f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15693:1874634253374336:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787790885.566956:0:15693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790885.567017:0:15693:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a43a1c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787790885.567112:0:16635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+18:2349:x1874634236618496:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 8300us (8594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790885.567124:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:1.0:1787790885.567380:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253374336 00000100:00100000:1.0:1787790885.567397:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253374336 00000100:00100000:1.0:1787790885.567482:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787790885.569948:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15693:x1874634253374336:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787790885.570219:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15693:x1874634253374336:12345-0@lo:1000:mdt00_003.0 Request processed in 2724us (3377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790885.570231:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790885.570470:0:15693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4794f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15693:1874634253374336:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787790885.573332:0:15693:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1787790885.573966:0:15693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a679c3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15693:1874634253374464:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787790885.574074:0:15693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790885.574154:0:15693:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a80c16a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787790885.575176:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253374464 00000100:00100000:1.0:1787790885.575193:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253374464 00000100:00100000:0.0:1787790885.575397:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787790885.575411:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15693:x1874634253374464:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787790885.576259:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:15693:x1874634253374464:12345-0@lo:1000:mdt00_003.0 Request processed in 848us (2182us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787790885.576271:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787790885.576411:0:15693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a679c3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15693:1874634253374464:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787790885.576470:0:15693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa97758f4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.576483:0:15693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa97758f4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.576492:0:15693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa97758f4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.576560:0:15693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f0400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790885.576566:0:15693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa97758f4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.576575:0:15693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa97758f4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.576654:0:15693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff931a541ad000) 00010000:00010000:1.0:1787790885.576659:0:15693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787790885.576667:0:15693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa97758f4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.576675:0:15693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0400/0x70647b5fa97758f4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.576754:0:15693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa977584c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.576768:0:15693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa977584c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.576774:0:15693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa977584c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.576779:0:15693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82153600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790885.576783:0:15693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa977584c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.576789:0:15693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa977584c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.576799:0:15693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff931a543e4100) 00010000:00010000:1.0:1787790885.576801:0:15693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787790885.576810:0:15693:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa9775853 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef68 expref: 18 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.576823:0:15693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa9775853 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef68 expref: 18 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.576833:0:15693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa9775853 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef68 expref: 18 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.576905:0:15693:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f0600/0x70647b5fa9775853 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0xb5a022183496ef68 expref: 18 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790885.576921:0:15693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4794f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15693:1874634253374592:192.168.201.25@tcp:105: 00000100:00100000:1.0:1787790885.577152:0:15693:0:(client.c:2715:ptlrpc_set_wait()) set ffff931a67cd1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787790885.585211:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.585319:0:15693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4794f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15693:1874634253374592:192.168.201.25@tcp:105: 00010000:00010000:1.0:1787790885.585361:0:15693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa977584c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.585376:0:15693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a82153600/0x70647b5fa977584c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.585425:0:15693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa97758fb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.585444:0:15693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa97758fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.585458:0:15693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa97758fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.585470:0:15693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa97758fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.585477:0:15693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa97758fb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.585485:0:15693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa97758fb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.585491:0:15693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f1400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790885.585547:0:15693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa97758fb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.585556:0:15693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa97758fb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.585641:0:15693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff931a543e4100) 00010000:00010000:1.0:1787790885.585645:0:15693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790885.585650:0:15693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa97758fb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.585657:0:15693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1400/0x70647b5fa97758fb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.585668:0:15693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa97758ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.585674:0:15693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa97758ed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.585680:0:15693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa97758ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.585685:0:15693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f1600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787790885.585688:0:15693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa97758ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.585694:0:15693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa97758ed lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.585701:0:15693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff931a543e4100) 00010000:00010000:1.0:1787790885.585703:0:15693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787790885.585705:0:15693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa97758ed lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.585710:0:15693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a542f1600/0x70647b5fa97758ed lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790885.586139:0:15693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+18:14494:x1874634236618368:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 31697us (31891us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1787790885.586154:0:15693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 53 00000020:00080000:1.0:1787790885.586162:0:15693:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787790885.587511:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236618624 00000100:00100000:2.0:1787790885.587523:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236618624 00000100:00100000:2.0:1787790885.587583:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:2.0:1787790885.587749:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d5ca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+18:14493:x1874634236618624:12345-192.168.201.25@tcp:49:dd.0 00000100:00100000:2.0:1787790885.587910:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d5ca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+18:14493:x1874634236618624:12345-192.168.201.25@tcp:49:dd.0 Request processed in 164us (2714us total) trans 0 rc 0/0 00000040:00080000:3.0:1787790885.589305:0:14444:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787790885.589324:0:14444:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787790885.589366:0:14444:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787790885.589377:0:14444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787790885.592238:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790885.592288:0:14414:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1787790885.592302:0:14414:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:1.0:1787790885.592786:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236618880 00000100:00100000:1.0:1787790885.592798:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236618880 00000100:00100000:0.0:1787790885.593942:0:16637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:0.0:1787790885.593960:0:16637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+19:14494:x1874634236618880:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787790885.594817:0:16637:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787790885.594927:0:16637:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1787790885.594972:0:16637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775902 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16637 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.594993:0:16637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775902 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16637 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.595007:0:16637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775902 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16637 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.595018:0:16637:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775902 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16637 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.595038:0:16637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775902 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16637 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.595045:0:16637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775902 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16637 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.595074:0:16637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787790885.595196:0:16637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+21:14494:x1874634236618880:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 1239us (2972us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1787790885.595207:0:16637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000020:00080000:0.0:1787790885.595213:0:16637:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787790885.595703:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790885.595713:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775902 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16637 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.595738:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981c00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790885.595744:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775902 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16637 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.595754:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775902 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16637 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.595771:0:14400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff931a541ad000) 00010000:00010000:1.0:1787790885.595775:0:14400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787790885.595781:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775902 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16637 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.595788:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff931a67981c00/0x70647b5fa9775902 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16637 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.595802:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790885.595804:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790885.595806:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790885.598367:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:1.0:1787790885.706897:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.706972:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790885.707100:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236619008 00000100:00100000:2.0:1787790885.707114:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236619008 00000100:00100000:2.0:1787790885.707201:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236619136 00000100:00100000:2.0:1787790885.707205:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236619136 00000100:00100000:2.0:1787790885.707227:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:2.0:1787790885.707236:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+8:2347:x1874634236619008:12345-192.168.201.25@tcp:4:dd.0 00002000:00010000:2.0:1787790885.707299:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a8f8625, atime: 0x6a8f8624, ctime: 0x6a8f8625, blocks: 0x1 00010000:00010000:2.0:1787790885.707311:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001afbfbf9/0x70647b5fa9775909 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790885.707333:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=420s v=(0 0) 00010000:00010000:2.0:1787790885.707338:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790885.707347:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001afbfbf9/0x70647b5fa9775909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790885.707364:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001afbfbf9/0x70647b5fa9775909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790885.717996:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.718052:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.718085:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.718100:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.718113:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1787790885.718132:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1787790885.718224:0:15101:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787790885.718246:0:15101:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1787790885.718811:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236619264 00000100:00100000:1.0:1787790885.718823:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236619264 00000100:00100000:1.0:1787790885.718903:0:15101:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787790885.718911:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236619520 00000100:00100000:1.0:1787790885.718915:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236619520 00000100:00100000:1.0:1787790885.718930:0:15101:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787790885.718935:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236619776 00000100:00100000:1.0:1787790885.718938:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236619776 00000100:00100000:1.0:1787790885.718950:0:15101:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787790885.718954:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236619392 00000100:00100000:1.0:1787790885.718957:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236619392 00000100:00100000:1.0:1787790885.718982:0:15101:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787790885.718988:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236619648 00000100:00100000:1.0:1787790885.718991:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236619648 00000100:00100000:1.0:1787790885.719005:0:15101:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787790885.719009:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236619904 00000100:00100000:1.0:1787790885.719012:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236619904 00000100:00100000:0.0:1787790885.720859:0:16638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:0.0:1787790885.720885:0:16638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+15:2347:x1874634236619136:12345-192.168.201.25@tcp:4:dd.0 00010000:00010000:0.0:1787790885.720929:0:16638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000689890bf/0x70647b5fa9775910 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.720947:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790885.720952:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790885.720958:0:16638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000689890bf/0x70647b5fa9775910 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790885.720971:0:16638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000689890bf/0x70647b5fa9775910 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790885.819859:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790885.819914:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790885.819945:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790885.819975:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236620032 00000100:00100000:2.0:1787790885.819984:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236620032 00000100:00100000:2.0:1787790885.820045:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 121 00000100:00100000:2.0:1787790885.820055:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a44c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+13:2346:x1874634236620032:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790885.820137:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a44c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a3ac9a5-f5aa-4a28-a6cc-5a15e00a72d4+13:2346:x1874634236620032:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 83us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790885.820146:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 121 00000100:00100000:2.0:1787790885.820208:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790885.820236:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236620288 00000100:00100000:2.0:1787790885.820241:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236620288 00000100:00100000:2.0:1787790885.820282:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:2.0:1787790885.820290:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d958f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+6:2346:x1874634236620288:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790885.820327:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d958f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+6:2346:x1874634236620288:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 39us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790885.820334:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:2.0:1787790885.820433:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1787790885.820458:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236620160 00000100:00100000:2.0:1787790885.820463:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236620160 00000100:00100000:2.0:1787790885.820495:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236620416 00000100:00100000:2.0:1787790885.820498:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236620416 00000100:00100000:2.0:1787790885.820508:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634236620544 00000100:00100000:2.0:1787790885.820510:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634236620544 00000100:00100000:2.0:1787790885.820524:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:2.0:1787790885.820544:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7db68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+5:2346:x1874634236620160:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790885.820571:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7db68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+5:2346:x1874634236620160:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 29us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790885.820578:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:2.0:1787790885.820591:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:2.0:1787790885.820597:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d95a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+5:2346:x1874634236620416:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790885.820636:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d95a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+5:2346:x1874634236620416:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 39us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790885.820643:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:2.0:1787790885.820655:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:2.0:1787790885.820661:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a7d95ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+5:2346:x1874634236620544:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1787790885.820683:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a7d95ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b71dcdc-a07d-4928-9d95-09dc7dd4d3b3+5:2346:x1874634236620544:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 22us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790885.820690:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00080000:2.0:1787790885.820706:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787790885.820710:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1787790885.851045:0:15099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1787790885.851056:0:15099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1787790885.851081:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001afbfbf9/0x70647b5fa9775909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.851094:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001afbfbf9/0x70647b5fa9775909 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.851102:0:15099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001afbfbf9/0x70647b5fa9775909 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.851109:0:15099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030600 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790885.851115:0:15099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001afbfbf9/0x70647b5fa9775909 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.851143:0:15099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001afbfbf9/0x70647b5fa9775909 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787790885.851163:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00010000:00010000:3.0:1787790885.851165:0:15099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001afbfbf9/0x70647b5fa9775909 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.851177:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001afbfbf9/0x70647b5fa9775909 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787790885.851189:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:2.0:1787790885.851207:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000100:00100000:3.0:1787790885.851280:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+15:2347:x1874634236619008:12345-192.168.201.25@tcp:4:dd.0 Request processed in 144038us (144391us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1787790885.851371:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:3.0:1787790885.851477:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:3.0:1787790885.851491:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+14:2347:x1874634236619264:12345-192.168.201.25@tcp:4:dd.0 00010000:00010000:3.0:1787790885.851579:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9775917 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.851592:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790885.851596:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790885.851602:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9775917 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790885.863643:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9775917 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787790885.942506:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:1.0:1787790885.942807:0:16638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1787790885.942814:0:16638:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:1.0:1787790885.942837:0:16638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000689890bf/0x70647b5fa9775910 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.942856:0:16638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000689890bf/0x70647b5fa9775910 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.942894:0:16638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000689890bf/0x70647b5fa9775910 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.942903:0:16638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a67981c00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:1.0:1787790885.942909:0:16638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000689890bf/0x70647b5fa9775910 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.942920:0:16638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000689890bf/0x70647b5fa9775910 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.942952:0:16638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000689890bf/0x70647b5fa9775910 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.942961:0:16638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000689890bf/0x70647b5fa9775910 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790885.943115:0:16638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+14:2347:x1874634236619136:12345-192.168.201.25@tcp:4:dd.0 Request processed in 222233us (236134us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787790885.943128:0:16638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:1.0:1787790885.943168:0:16638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:1.0:1787790885.943181:0:16638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+13:2347:x1874634236619520:12345-192.168.201.25@tcp:4:dd.0 00010000:00010000:1.0:1787790885.943222:0:16638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000895f1633/0x70647b5fa977591e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.943239:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790885.943252:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790885.943260:0:16638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000895f1633/0x70647b5fa977591e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790885.943272:0:16638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000895f1633/0x70647b5fa977591e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790885.952054:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93194581da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253374720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790885.952158:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790885.952342:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253374720 00000100:00100000:3.0:1787790885.952351:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253374720 00000100:00100000:3.0:1787790885.952422:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787790885.952432:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253374720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790885.952478:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787790885.952526:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874634253374720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790885.952534:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787790885.952562:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790885.953544:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a679c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253374848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790885.953997:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790885.954094:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93194581da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1874634253374720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787790885.954308:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253374848 00000100:00100000:0.0:1787790885.954317:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253374848 00000100:00100000:0.0:1787790885.954365:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787790885.954376:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253374848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787790885.954402:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 61276160 pending 3407872 free 3859808256 avail 3855613952 00000100:00100000:0.0:1787790885.954451:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874634253374848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790885.954459:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787790885.954515:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4794f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8529acdd-b606-48f0-be71-c40064ed5481:3318:1874634253374976:0@lo:400:kworker.0 00000100:00100000:3.0:1787790885.954551:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790885.954736:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253374976 00000100:00100000:0.0:1787790885.954741:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253374976 00000100:00100000:0.0:1787790885.954769:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787790885.954775:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a679d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+19:3318:x1874634253374976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790885.955277:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790885.955285:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4794cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253375104:0@lo:400:kworker.0 00000100:00100000:0.0:1787790885.955338:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a679d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8529acdd-b606-48f0-be71-c40064ed5481+19:3318:x1874634253374976:12345-0@lo:400:kworker.0 Request processed in 562us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790885.955354:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787790885.955425:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4794c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253375232:0@lo:400:kworker.0 00000100:00100000:3.0:1787790885.955436:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790885.955477:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff931a4794de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1874634253375360:0@lo:400:kworker.0 00000100:00100000:3.0:1787790885.955525:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4794f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8529acdd-b606-48f0-be71-c40064ed5481:3318:1874634253374976:0@lo:400:kworker.0 00000100:00100000:0.0:1787790885.955641:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253375104 00000100:00100000:0.0:1787790885.955647:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253375104 00000100:00100000:0.0:1787790885.955685:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787790885.955692:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93194581da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253375104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790885.956179:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93194581da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874634253375104:12345-0@lo:400:kworker.0 Request processed in 485us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790885.956190:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787790885.956248:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4794cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874634253375104:0@lo:400:kworker.0 00000100:00100000:1.0:1787790885.956785:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790885.956843:0:3321:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1787790885.956851:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff931a8119a1c0, transno 8589934595 00000100:00100000:3.0:1787790885.956895:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253375360 00000100:00100000:3.0:1787790885.956908:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253375360 00000004:00080000:1.0:1787790885.956919:0:3321:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1787790885.956957:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a679c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1874634253374848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790885.956963:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787790885.956973:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874634253375360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790885.957044:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874634253375360:12345-0@lo:400:kworker.0 Request processed in 73us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790885.957051:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787790885.957077:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790885.957111:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790885.957136:0:15693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634253375232 00000100:00100000:3.0:1787790885.957141:0:15693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634253375232 00000100:00100000:1.0:1787790885.957173:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4794de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1874634253375360:0@lo:400:kworker.0 00000100:00100000:3.0:1787790885.957176:0:15693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787790885.957187:0:15693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253375232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790885.957232:0:15693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874634253375232:12345-0@lo:400:kworker.0 Request processed in 46us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790885.957238:0:15693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787790885.957256:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790885.959633:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff931a4794c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1874634253375232:0@lo:400:kworker.0 00000001:00080000:0.0:1787790886.012784:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00010000:00010000:3.0:1787790886.016882:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787790886.019842:0:15099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:3.0:1787790886.019849:0:15099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:3.0:1787790886.019866:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9775917 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.019893:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9775917 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.019904:0:15099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9775917 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.019912:0:15099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152200 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790886.019940:0:15099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9775917 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.019951:0:15099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9775917 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.019973:0:15099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9775917 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.019982:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa9775917 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790886.020105:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+13:2347:x1874634236619264:12345-192.168.201.25@tcp:4:dd.0 Request processed in 168612us (302126us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787790886.020117:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:3.0:1787790886.020160:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:3.0:1787790886.020176:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+12:2347:x1874634236619776:12345-192.168.201.25@tcp:4:dd.0 00010000:00010000:3.0:1787790886.020216:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa9775925 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.020229:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790886.020234:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790886.020241:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa9775925 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.020255:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa9775925 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787790886.059281:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:3.0:1787790886.060222:0:16638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7340032 00010000:00010000:3.0:1787790886.060245:0:16638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000895f1633/0x70647b5fa977591e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.060258:0:16638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000895f1633/0x70647b5fa977591e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.060267:0:16638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000895f1633/0x70647b5fa977591e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.060272:0:16638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a542f0400 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790886.060276:0:16638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000895f1633/0x70647b5fa977591e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.060286:0:16638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000895f1633/0x70647b5fa977591e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.060308:0:16638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000895f1633/0x70647b5fa977591e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.060312:0:16638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000895f1633/0x70647b5fa977591e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790886.060437:0:16638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+12:2347:x1874634236619520:12345-192.168.201.25@tcp:4:dd.0 Request processed in 117253us (342377us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787790886.060467:0:16638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:3.0:1787790886.060503:0:16638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:3.0:1787790886.060516:0:16638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+11:2347:x1874634236619392:12345-192.168.201.25@tcp:4:dd.0 00010000:00010000:3.0:1787790886.060562:0:16638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa977592c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.061839:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790886.061851:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790886.061859:0:16638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa977592c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.061876:0:16638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa977592c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787790886.094443:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:3.0:1787790886.094464:0:15099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:3.0:1787790886.094495:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa9775925 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.094514:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa9775925 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.094527:0:15099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa9775925 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.094536:0:15099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152c00 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:3.0:1787790886.094543:0:15099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa9775925 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.094574:0:15099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa9775925 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.094607:0:15099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa9775925 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790886.094616:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4187b93/0x70647b5fa9775925 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790886.095802:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+9:2347:x1874634236619776:12345-192.168.201.25@tcp:4:dd.0 Request processed in 75617us (377699us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1787790886.095821:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:2.0:1787790886.095871:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:2.0:1787790886.095887:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+8:2347:x1874634236619648:12345-192.168.201.25@tcp:4:dd.0 00010000:00010000:2.0:1787790886.096107:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004371f2e2/0x70647b5fa9775933 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790886.096127:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790886.096132:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790886.096141:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004371f2e2/0x70647b5fa9775933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790886.096157:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004371f2e2/0x70647b5fa9775933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787790886.145309:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:2.0:1787790886.145492:0:16638:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:2.0:1787790886.145520:0:16638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa977592c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790886.145536:0:16638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa977592c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790886.145546:0:16638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa977592c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790886.145564:0:16638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a82152200 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:2.0:1787790886.145570:0:16638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa977592c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790886.145580:0:16638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa977592c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790886.145642:0:16638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa977592c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790886.145652:0:16638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a7afc2f/0x70647b5fa977592c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790886.145810:0:16638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+10:2347:x1874634236619392:12345-192.168.201.25@tcp:4:dd.0 Request processed in 85293us (427702us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787790886.145821:0:16638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:2.0:1787790886.145864:0:16638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:2.0:1787790886.145890:0:16638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931a4794cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+9:2347:x1874634236619904:12345-192.168.201.25@tcp:4:dd.0 00010000:00010000:2.0:1787790886.145927:0:16638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000988ece3d/0x70647b5fa977593a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790886.145941:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787790886.145945:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790886.145953:0:16638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000988ece3d/0x70647b5fa977593a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790886.145965:0:16638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000988ece3d/0x70647b5fa977593a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787790886.196778:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:0.0:1787790886.198466:0:15099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1787790886.198480:0:15099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:0.0:1787790886.198501:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004371f2e2/0x70647b5fa9775933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790886.198519:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004371f2e2/0x70647b5fa9775933 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790886.198532:0:15099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004371f2e2/0x70647b5fa9775933 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790886.198541:0:15099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40031000 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:0.0:1787790886.198548:0:15099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004371f2e2/0x70647b5fa9775933 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790886.198558:0:15099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004371f2e2/0x70647b5fa9775933 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790886.198602:0:15099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004371f2e2/0x70647b5fa9775933 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790886.198609:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004371f2e2/0x70647b5fa9775933 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790886.198875:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+9:2347:x1874634236619648:12345-192.168.201.25@tcp:4:dd.0 Request processed in 102983us (480747us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787790886.198889:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00010000:00010000:2.0:1787790886.232462:0:16638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000988ece3d/0x70647b5fa977593a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790886.232513:0:16638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000988ece3d/0x70647b5fa977593a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790886.232524:0:16638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000988ece3d/0x70647b5fa977593a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790886.232533:0:16638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931a40030000 already unused, calling callback (ffffffffc17e2420) 00010000:00010000:2.0:1787790886.232539:0:16638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000988ece3d/0x70647b5fa977593a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790886.232550:0:16638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000988ece3d/0x70647b5fa977593a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790886.232588:0:16638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000988ece3d/0x70647b5fa977593a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790886.232598:0:16638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000988ece3d/0x70647b5fa977593a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790886.232785:0:16638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931a4794cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a6fae00d-d3c7-4f7d-9a32-5259e3f1cee6+7:2347:x1874634236619904:12345-192.168.201.25@tcp:4:dd.0 Request processed in 86905us (514644us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787790886.232798:0:16638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000001:00080000:1.0:1787790886.233053:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:1.0:1787790887.039955:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787790887.851963:0:16677:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1787790888.063878:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790889.088411:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 28930 lines, 28930 kept, 0 dropped, 0 bad.